Documenti analoghi

• Large Language Models as Urban Residents: An LLM Agent Framework for Personal Mobility Generation
  di: Wang, Jiawei, et al.
  Pubblicazione: (2024)
• KVSharer: Efficient Inference via Layer-Wise Dissimilar KV Cache Sharing
  di: Yang, Yifei, et al.
  Pubblicazione: (2024)
• MaskPrune: Mask-based LLM Pruning for Layer-wise Uniform Structures
  di: Qin, Jiayu, et al.
  Pubblicazione: (2025)
• KVTuner: Sensitivity-Aware Layer-Wise Mixed-Precision KV Cache Quantization for Efficient and Nearly Lossless LLM Inference
  di: Li, Xing, et al.
  Pubblicazione: (2025)
• LazyLLM: Dynamic Token Pruning for Efficient Long Context LLM Inference
  di: Fu, Qichen, et al.
  Pubblicazione: (2024)