CoFormer: Collaborating with Heterogeneous Edge Devices for Scalable Transformer Inference

Documenti analoghi

• Collaborative Processing for Multi-Tenant Inference on Memory-Constrained Edge TPUs
  di: Ng, Nathan, et al.
  Pubblicazione: (2026)
• HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices
  di: Zhao, Xuanlei, et al.
  Pubblicazione: (2024)
• Opt4GPTQ: Co-Optimizing Memory and Computation for 4-bit GPTQ Quantized LLM Inference on Heterogeneous Platforms
  di: Zhang, Yaozheng, et al.
  Pubblicazione: (2025)
• Active Inference-Based Adaptive Routing for Heterogeneous Edge AI Services
  di: Wang, Zihang, et al.
  Pubblicazione: (2026)
• CoServe: Efficient Collaboration-of-Experts (CoE) Model Inference with Limited Memory
  di: Suo, Jiashun, et al.
  Pubblicazione: (2025)