LaMPE: Length-aware Multi-grained Positional Encoding for Adaptive Long-context Scaling Without Training

Documenti analoghi

• DAPE: Data-Adaptive Positional Encoding for Length Extrapolation
  di: Zheng, Chuanyang, et al.
  Pubblicazione: (2024)
• Beyond Sequential Distance: Inter-Modal Distance Invariant Position Encoding
  di: Chen, Lin, et al.
  Pubblicazione: (2026)
• MEP: Multiple Kernel Learning Enhancing Relative Positional Encoding Length Extrapolation
  di: Gao, Weiguo
  Pubblicazione: (2024)
• OMEGA: Optimized Multimodal Position Encoding Index Derivation with Global Adaptive Scaling for Vision-Language Models
  di: Huang, Ruoxiang, et al.
  Pubblicazione: (2025)
• Length Extrapolation of Transformers: A Survey from the Perspective of Positional Encoding
  di: Zhao, Liang, et al.
  Pubblicazione: (2023)