An Explorative Study on Distributed Computing Techniques in Training and Inference of Large Language Models

Documenti analoghi

• Network Edge Inference for Large Language Models: Principles, Techniques, and Opportunities
  di: Chen, Zhixiong, et al.
  Pubblicazione: (2026)
• TokenSim: Enabling Hardware and Software Exploration for Large Language Model Inference Systems
  di: Wu, Feiyang, et al.
  Pubblicazione: (2025)
• Characterizing Communication Patterns in Distributed Large Language Model Inference
  di: Xu, Lang, et al.
  Pubblicazione: (2025)
• Efficient Training of Large Language Models on Distributed Infrastructures: A Survey
  di: Duan, Jiangfei, et al.
  Pubblicazione: (2024)
• Galvatron: Automatic Distributed Training for Large Transformer Models
  di: Gumaan, Esmail
  Pubblicazione: (2025)