Collaborative Speculative Inference for Efficient LLM Inference Serving

Documenti analoghi

• Accelerating End-Cloud Collaborative Inference via Near Bubble-free Pipeline Optimization
  di: Gao, Luyao, et al.
  Pubblicazione: (2024)
• Many Hands Make Light Work: Accelerating Edge Inference via Multi-Client Collaborative Caching
  di: Liang, Wenyi, et al.
  Pubblicazione: (2024)
• SemiSFL: Split Federated Learning on Unlabeled and Non-IID Data
  di: Xu, Yang, et al.
  Pubblicazione: (2023)
• Caesar: A Low-deviation Compression Approach for Efficient Federated Learning
  di: Yan, Jiaming, et al.
  Pubblicazione: (2024)
• Mitigating Catastrophic Forgetting with Adaptive Transformer Block Expansion in Federated Fine-Tuning
  di: Huo, Yujia, et al.
  Pubblicazione: (2025)