This is a special post for quick takes by _rpd. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
Oracle experiments show that enriching the KV-Cache semantics can improve response quality without increasing cache size, supporting KV-Cache as an effective medium for inter-model communication.
lots of claims without much evidence, but it'll be interesting to see how much actual learning is transferable.