Enhancing Inference Efficiency of Large Language Models: Investigating Optimization Strategies and Architectural Innovations

Documenti analoghi

• Model Compression and Efficient Inference for Large Language Models: A Survey
  di: Wang, Wenxiao, et al.
  Pubblicazione: (2024)
• CITER: Collaborative Inference for Efficient Large Language Model Decoding with Token-Level Routing
  di: Zheng, Wenhao, et al.
  Pubblicazione: (2025)
• Data Efficacy for Language Model Training
  di: Dai, Yalun, et al.
  Pubblicazione: (2025)
• Research on Low-Latency Inference and Training Efficiency Optimization for Graph Neural Network and Large Language Model-Based Recommendation Systems
  di: Zhao, Yushang, et al.
  Pubblicazione: (2025)
• Bench360: Benchmarking Local LLM Inference from 360 Degrees
  di: Stuhlmann, Linus, et al.
  Pubblicazione: (2025)