ModeSwitch-LLM: A Lightweight Phase-Aware Controller for Cross-Mode LLM Inference on a Single GPU

Documenti analoghi

• Bench360: Benchmarking Local LLM Inference from 360 Degrees
  di: Stuhlmann, Linus, et al.
  Pubblicazione: (2025)
• ISO: Overlap of Computation and Communication within Seqenence For LLM Inference
  di: Xiao, Bin, et al.
  Pubblicazione: (2024)
• Characterizing WebGPU Dispatch Overhead for LLM Inference Across Four GPU Vendors, Three Backends, and Three Browsers
  di: Maczan, Jędrzej
  Pubblicazione: (2026)
• QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving
  di: Lin, Yujun, et al.
  Pubblicazione: (2024)
• Systematic Evaluation of Optimization Techniques for Long-Context Language Models
  di: Ahmed, Ammar, et al.
  Pubblicazione: (2025)