MIT is currently running simulations of their Jenga system that can reallocate cache access on the fly in order to create "cache hierarchies" specifically tailored for any program. Jenga can lead to performance increases of up to 30% and up to 86% reduced power consumption.
https://www.notebookcheck.net/On-the-fly-hierarchical-caches-could-speed-up-CPUs.232818.0.html