MOM: Memory-Efficient Offloaded Mini-Sequence Inference for Long Context Language Models

Documenti analoghi

• HeadInfer: Memory-Efficient LLM Inference by Head-wise Offloading
  di: Luo, Cheng, et al.
  Pubblicazione: (2025)
• MiniCPM-SALA: Hybridizing Sparse and Linear Attention for Efficient Long-Context Modeling
  di: MiniCPM Team, et al.
  Pubblicazione: (2026)
• Mini-Sequence Transformer: Optimizing Intermediate Memory for Long Sequences Training
  di: Luo, Cheng, et al.
  Pubblicazione: (2024)
• InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory
  di: Xiao, Chaojun, et al.
  Pubblicazione: (2024)
• Star Attention: Efficient LLM Inference over Long Sequences
  di: Acharya, Shantanu, et al.
  Pubblicazione: (2024)