DAC: A Dynamic Attention-aware Approach for Task-Agnostic Prompt Compression

Documenti analoghi

• KV-Latent: Dimensional-level KV Cache Reduction with Frequency-aware Rotary Positional Embedding
  di: Shi, Luohe, et al.
  Pubblicazione: (2025)
• XQuant: Achieving Ultra-Low Bit KV Cache Quantization with Cross-Layer Compression
  di: Yang, Haoqi, et al.
  Pubblicazione: (2025)
• Scaling LLM Speculative Decoding: Non-Autoregressive Forecasting in Large-Batch Scenarios
  di: Shi, Luohe, et al.
  Pubblicazione: (2025)
• End-to-end Contrastive Language-Speech Pretraining Model For Long-form Spoken Question Answering
  di: Hu, Jiliang, et al.
  Pubblicazione: (2025)
• IAM: Efficient Inference through Attention Mapping between Different-scale LLMs
  di: Zhao, Yi, et al.
  Pubblicazione: (2025)