Research Note: Self-Compaction Gives LLMs a Hidden Boost in KV State Propagation

New work from Dimitris Papailiopoulos's group shows that teaching models to compact their own context produces an unexpected side benefit in how key-value cache state propagates.