
ReplaySSM: Rethinking State Storage for Faster Hybrid-Model Decoding
NVIDIA and Princeton’s Dao lab cache SSM inputs instead of full state, cutting decode traffic roughly in half and making speculative decoding work for hybrid models that were stuck on bandwidth.









