Fundamental Limits of Prompt Compression: A Rate-Distortion Framework for Black-Box Language Models

Documenti analoghi

• Attention with Markov: A Framework for Principled Analysis of Transformers via Markov Chains
  di: Makkuva, Ashok Vardhan, et al.
  Pubblicazione: (2024)
• Local to Global: Learning Dynamics and Effect of Initialization for Transformers
  di: Makkuva, Ashok Vardhan, et al.
  Pubblicazione: (2024)
• TERMINATOR: Learning Optimal Exit Points for Early Stopping in Chain-of-Thought Reasoning
  di: Nagle, Alliot, et al.
  Pubblicazione: (2026)
• Transformers on Markov Data: Constant Depth Suffices
  di: Rajaraman, Nived, et al.
  Pubblicazione: (2024)
• LASER: Linear Compression in Wireless Distributed Optimization
  di: Makkuva, Ashok Vardhan, et al.
  Pubblicazione: (2023)