Faster MoE LLM Inference for Extremely Large Models

Documenti analoghi

• Reference Trustable Decoding: A Training-Free Augmentation Paradigm for Large Language Models
  di: Shi, Luohe, et al.
  Pubblicazione: (2024)
• Keep the Cost Down: A Review on Methods to Optimize LLM' s KV-Cache Consumption
  di: Shi, Luohe, et al.
  Pubblicazione: (2024)
• Scaling LLM Speculative Decoding: Non-Autoregressive Forecasting in Large-Batch Scenarios
  di: Shi, Luohe, et al.
  Pubblicazione: (2025)
• From Parameters to Performance: A Data-Driven Study on LLM Structure and Development
  di: Wang, Suqing, et al.
  Pubblicazione: (2025)
• IAM: Efficient Inference through Attention Mapping between Different-scale LLMs
  di: Zhao, Yi, et al.
  Pubblicazione: (2025)