The main bottleneck is latency, which really only improves by shortening the distance between two components. That's why, as Urwumpe said, RAM modules are close to the CPU, and why caches are located inside it.
The other possibility is by exchanging electrons with photons, but I don't think...