Image de couverture de livre

Mesa-Extrapolation: A Weave Position Encoding Method for Enhanced Extrapolation in LLMs

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Ma, Xin, Liu, Yang, Liu, Jingjing, Ma, Xiaoxu
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

MEP: Multiple Kernel Learning Enhancing Relative Positional Encoding Length Extrapolation
par: Gao, Weiguo
Publié: (2024)

Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation
par: He, Zhenyu, et autres
Publié: (2024)

HoPE: A Novel Positional Encoding Without Long-Term Decay for Enhanced Context Awareness and Extrapolation
par: Chen, Yuhan, et autres
Publié: (2024)

Multi-Value Alignment for LLMs via Value Decorrelation and Extrapolation
par: Xu, Hefei, et autres
Publié: (2025)

The Extrapolation Power of Implicit Models
par: Decugis, Juliette, et autres
Publié: (2024)

Identifying Representations for Intervention Extrapolation
par: Saengkyongam, Sorawit, et autres
Publié: (2023)

Enhanced Diffusion Sampling via Extrapolation with Multiple ODE Solutions
par: Choi, Jinyoung, et autres
Publié: (2025)

Gradient Extrapolation-Based Policy Optimization
par: Swapnil, Ismam Nur, et autres
Publié: (2026)

Data Difficulty and the Generalization--Extrapolation Tradeoff in LLM Fine-Tuning
par: Liu, Siyuan, et autres
Publié: (2026)

Learning beyond Teacher: Generalized On-Policy Distillation with Reward Extrapolation
par: Yang, Wenkai, et autres
Publié: (2026)

Extrapolation of Periodic Functions Using Binary Encoding of Continuous Numerical Values
par: Powell, Brian P., et autres
Publié: (2025)

Towards Understanding Extrapolation: a Causal Lens
par: Kong, Lingjing, et autres
Publié: (2025)

Diverging Flows: Detecting Extrapolations in Conditional Generation
par: Tsakonas, Constantinos, et autres
Publié: (2026)

Anon: Extrapolating Adaptivity Beyond SGD and Adam
par: Zhang, Yiheng, et autres
Publié: (2026)

Model Extrapolation Expedites Alignment
par: Zheng, Chujie, et autres
Publié: (2024)

InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory
par: Xiao, Chaojun, et autres
Publié: (2024)

Angle Domain Guidance: Latent Diffusion Requires Rotation Rather Than Extrapolation
par: Jin, Cheng, et autres
Publié: (2025)

DeciMamba: Exploring the Length Extrapolation Potential of Mamba
par: Ben-Kish, Assaf, et autres
Publié: (2024)

REE-TTT: Highly Adaptive Radar Echo Extrapolation Based on Test-Time Training
par: Di, Xin, et autres
Publié: (2026)

TabularMath: Evaluating Computational Extrapolation in Tabular Learning via Program-Verified Synthesis
par: Cheng, Zerui, et autres
Publié: (2026)

RLPR: Extrapolating RLVR to General Domains without Verifiers
par: Yu, Tianyu, et autres
Publié: (2025)

SAFLEX: Self-Adaptive Augmentation via Feature Label Extrapolation
par: Ding, Mucong, et autres
Publié: (2024)

Extrapolated Urban View Synthesis Benchmark
par: Han, Xiangyu, et autres
Publié: (2024)

Bayesian Neural Scaling Law Extrapolation with Prior-Data Fitted Networks
par: Lee, Dongwoo, et autres
Publié: (2025)

Beyond Interpolation: Extrapolative Reasoning with Reinforcement Learning and Graph Neural Networks
par: Grillo, Niccolò, et autres
Publié: (2025)

Excluding the Target Domain Improves Extrapolation: Deconfounded Hierarchical Physics Constraints
par: Okita, Tsuyoshi
Publié: (2026)

Painless Federated Learning: An Interplay of Line-Search and Extrapolation
par: Geetika, et autres
Publié: (2024)

Architecture-Aware Learning Curve Extrapolation via Graph Ordinary Differential Equation
par: Ding, Yanna, et autres
Publié: (2024)

Cost-Sensitive Multi-Fidelity Bayesian Optimization with Transfer of Learning Curve Extrapolation
par: Lee, Dong Bok, et autres
Publié: (2024)

NeuralSolver: Learning Algorithms For Consistent and Efficient Extrapolation Across General Tasks
par: Esteves, Bernardo, et autres
Publié: (2024)

Position as Probability: Self-Supervised Transformers that Think Past Their Training for Length Extrapolation
par: Lee, Philip Heejun
Publié: (2025)

Neon: Negative Extrapolation From Self-Training Improves Image Generation
par: Alemohammad, Sina, et autres
Publié: (2025)

Physics-informed Attention-enhanced Fourier Neural Operator for Solar Magnetic Field Extrapolations
par: Cao, Jinghao, et autres
Publié: (2025)

Does Your Neural Network Extrapolate? Feature Engineering as Identifiability Bias for OOD Generalization
par: Aguilar, Leonel, et autres
Publié: (2026)

Accelerating AI Performance using Anderson Extrapolation on GPUs
par: Dajani, Saleem Abdul Fattah Ahmed Al, et autres
Publié: (2024)

Extrapolative Weight Averaging Reveals Correctness-Efficiency Frontiers in Code RL
par: Zheng, Kunhao, et autres
Publié: (2026)

Video Latent Flow Matching: Optimal Polynomial Projections for Video Interpolation and Extrapolation
par: Cao, Yang, et autres
Publié: (2025)

Softplus Attention with Re-weighting Boosts Length Extrapolation in Large Language Models
par: Gao, Bo, et autres
Publié: (2025)

TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selection
par: Wu, Wei, et autres
Publié: (2024)

Agentic Web: Weaving the Next Web with AI Agents
par: Yang, Yingxuan, et autres
Publié: (2025)