Skip to yearly menu bar Skip to main content


CAOTE: Optimizing KV Cache Memory Through Attention Output Error-based Token Eviction

Raghavv Goel ⋅ Junyoung Park ⋅ Mukul Gagrani ⋅ Dalton Jones ⋅ Matthew Morse ⋅ Matthew Harper Langston ⋅ Christopher Lott ⋅ Mingu Lee

Abstract

Chat is not available.