Apple Paper Shows How to Convert Transformers to Mamba SSMs Without Retraining

A new Apple research paper describes a method for distilling Transformer models into Mamba-style state space models, enabling cheaper long-context inference without full retraining.