Reduce memory usage of the LRU caches.