WindowQuant: Mixed-Precision KV Cache Quantization based on Window-Level Similarity for VLMs Inference Optimization

Documenti analoghi

• Value-Driven Mixed-Precision Quantization for Patch-Based Inference on Microcontrollers
  di: Tao, Wei, et al.
  Pubblicazione: (2024)
• Cocktail: Chunk-Adaptive Mixed-Precision Quantization for Long-Context LLM Inference
  di: Tao, Wei, et al.
  Pubblicazione: (2025)
• MoQAE: Mixed-Precision Quantization for Long-Context LLM Inference via Mixture of Quantization-Aware Experts
  di: Tao, Wei, et al.
  Pubblicazione: (2025)
• MADLLM: Multivariate Anomaly Detection via Pre-trained LLMs
  di: Tao, Wei, et al.
  Pubblicazione: (2025)
• VisTa: Visual-contextual and Text-augmented Zero-shot Object-level OOD Detection
  di: Zhang, Bin, et al.
  Pubblicazione: (2025)