HoPE: A Novel Positional Encoding Without Long-Term Decay for Enhanced Context Awareness and Extrapolation

Documenti analoghi

• HoPE: Hyperbolic Rotary Positional Encoding for Stable Long-Range Dependency Modeling in Large Language Models
  di: Dai, Chang, et al.
  Pubblicazione: (2025)
• HoPE: Hybrid of Position Embedding for Long Context Vision-Language Models
  di: Li, Haoran, et al.
  Pubblicazione: (2025)
• More is not always better? Enhancing Many-Shot In-Context Learning with Differentiated and Reweighting Objectives
  di: Zhang, Xiaoqing, et al.
  Pubblicazione: (2025)
• Mixture of In-Context Experts Enhance LLMs' Long Context Awareness
  di: Lin, Hongzhan, et al.
  Pubblicazione: (2024)
• Fortify the Shortest Stave in Attention: Enhancing Context Awareness of Large Language Models for Effective Tool Use
  di: Chen, Yuhan, et al.
  Pubblicazione: (2023)