XL3M: A Training-free Framework for LLM Length Extension Based on Segment-wise Inference

Documenti analoghi

• Efficient Long-Context LLM Inference via KV Cache Clustering
  di: Hu, Jie, et al.
  Pubblicazione: (2025)
• BigMac: A Communication-Efficient Mixture-of-Experts Model Structure for Fast Training and Inference
  di: Jin, Zewen, et al.
  Pubblicazione: (2025)
• HATA: Trainable and Hardware-Efficient Hash-Aware Top-k Attention for Scalable Large Model Inference
  di: Gong, Ping, et al.
  Pubblicazione: (2025)
• LiteCache: A Query Similarity-Driven, GPU-Centric KVCache Subsystem for Efficient LLM Inference
  di: Yi, Jiawei, et al.
  Pubblicazione: (2025)
• HyLRA: Hybrid Layer Reuse Attention for Efficient Long-Context Inference
  di: Ai, Xuan, et al.
  Pubblicazione: (2026)