Speed up incremental syncs in sliding sync by adding some more caching.