MoQAE: Mixed-Precision Quantization for Long-Context LLM Inference via Mixture of Quantization-Aware Experts

Documenti analoghi

• Cocktail: Chunk-Adaptive Mixed-Precision Quantization for Long-Context LLM Inference
  di: Tao, Wei, et al.
  Pubblicazione: (2025)
• Value-Driven Mixed-Precision Quantization for Patch-Based Inference on Microcontrollers
  di: Tao, Wei, et al.
  Pubblicazione: (2024)
• WindowQuant: Mixed-Precision KV Cache Quantization based on Window-Level Similarity for VLMs Inference Optimization
  di: Tao, Wei, et al.
  Pubblicazione: (2026)
• Vista: Scene-Aware Optimization for Streaming Video Question Answering under Post-Hoc Queries
  di: Lu, Haocheng, et al.
  Pubblicazione: (2026)
• BAGNet: A Boundary-Aware Graph Attention Network for 3D Point Cloud Semantic Segmentation
  di: Tao, Wei, et al.
  Pubblicazione: (2025)