Image de couverture de livre

Towards Infinite Length Extrapolation: A Unified Approach

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Vetcha, Nitin
Format:	Preprint
Publié:	2026
Sujets:	Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

SOLAR: A Self-Optimizing Open-Ended Autonomous Agent for Lifelong Learning and Continual Adaptation
par: Vetcha, Nitin, et autres
Publié: (2026)

A Unified Temporal Knowledge Graph Reasoning Model Towards Interpolation and Extrapolation
par: Chen, Kai, et autres
Publié: (2024)

Extrapolation by Association: Length Generalization Transfer in Transformers
par: Cai, Ziyang, et autres
Publié: (2025)

A Training-Free Length Extrapolation Approach for LLMs: Greedy Attention Logit Interpolation (GALI)
par: Li, Yan, et autres
Publié: (2025)

DeciMamba: Exploring the Length Extrapolation Potential of Mamba
par: Ben-Kish, Assaf, et autres
Publié: (2024)

Effective Length Extrapolation via Dimension-Wise Positional Embeddings Manipulation
par: Lu, Yi, et autres
Publié: (2025)

MEP: Multiple Kernel Learning Enhancing Relative Positional Encoding Length Extrapolation
par: Gao, Weiguo
Publié: (2024)

An Evaluation of Context Length Extrapolation in Long Code via Positional Embeddings and Efficient Attention
par: Ghosh, Madhusudan, et autres
Publié: (2026)

Towards Understanding Extrapolation: a Causal Lens
par: Kong, Lingjing, et autres
Publié: (2025)

Softplus Attention with Re-weighting Boosts Length Extrapolation in Large Language Models
par: Gao, Bo, et autres
Publié: (2025)

GSM-Infinite: How Do Your LLMs Behave over Infinitely Increasing Context Length and Reasoning Complexity?
par: Zhou, Yang, et autres
Publié: (2025)

Two Stones Hit One Bird: Bilevel Positional Encoding for Better Length Extrapolation
par: He, Zhenyu, et autres
Publié: (2024)

Extrapolation Merging: Keep Improving With Extrapolation and Merging
par: Lin, Yiguan, et autres
Publié: (2025)

LM-Infinite: Zero-Shot Extreme Length Generalization for Large Language Models
par: Han, Chi, et autres
Publié: (2023)

Mesa-Extrapolation: A Weave Position Encoding Method for Enhanced Extrapolation in LLMs
par: Ma, Xin, et autres
Publié: (2024)

Position as Probability: Self-Supervised Transformers that Think Past Their Training for Length Extrapolation
par: Lee, Philip Heejun
Publié: (2025)

Leveraging Weighted Syntactic and Semantic Context Assessment Summary (wSSAS) Towards Text Categorization Using LLMs
par: Kathuria, Shreeya Verma, et autres
Publié: (2026)

CognTKE: A Cognitive Temporal Knowledge Extrapolation Framework
par: Chen, Wei, et autres
Publié: (2024)

Towards Infinite-Long Prefix in Transformer
par: Liang, Yingyu, et autres
Publié: (2024)

The Extrapolation Power of Implicit Models
par: Decugis, Juliette, et autres
Publié: (2024)

Identifying Representations for Intervention Extrapolation
par: Saengkyongam, Sorawit, et autres
Publié: (2023)

TokenSelect: Efficient Long-Context Inference and Length Extrapolation for LLMs via Dynamic Token-Level KV Cache Selection
par: Wu, Wei, et autres
Publié: (2024)

Gradient Extrapolation-Based Policy Optimization
par: Swapnil, Ismam Nur, et autres
Publié: (2026)

OntoTKGE: Ontology-Enhanced Temporal Knowledge Graph Extrapolation
par: Lin, Dongying, et autres
Publié: (2026)

Negative-Aware Diffusion Process for Temporal Knowledge Graph Extrapolation
par: Gan, Yanglei, et autres
Publié: (2026)

Towards Unified Approaches in Self-Supervised Event Stream Modeling: Progress and Prospects
par: Zólyomi, Levente, et autres
Publié: (2025)

A Dual Certificate Approach to Sparsity in Infinite-Width Shallow Neural Networks
par: Del Grande, Leonardo, et autres
Publié: (2026)

AccDiffusion v2: Towards More Accurate Higher-Resolution Diffusion Extrapolation
par: Lin, Zhihang, et autres
Publié: (2024)

Towards Unified Semantic and Controllable Image Fusion: A Diffusion Transformer Approach
par: Li, Jiayang, et autres
Publié: (2025)

Diverging Flows: Detecting Extrapolations in Conditional Generation
par: Tsakonas, Constantinos, et autres
Publié: (2026)

Anon: Extrapolating Adaptivity Beyond SGD and Adam
par: Zhang, Yiheng, et autres
Publié: (2026)

Scaling Laws of RoPE-based Extrapolation
par: Liu, Xiaoran, et autres
Publié: (2023)

Towards Unified Neurosymbolic Reasoning on Knowledge Graphs
par: Lin, Qika, et autres
Publié: (2025)

Towards Unifying Perceptual Reasoning and Logical Reasoning
par: Kido, Hiroyuki
Publié: (2022)

Model Extrapolation Expedites Alignment
par: Zheng, Chujie, et autres
Publié: (2024)

Quantitative Technology Forecasting: a Review of Trend Extrapolation Methods
par: Tsai, Peng-Hung, et autres
Publié: (2024)

Towards Security-Auditable LLM Agents: A Unified Graph Representation
par: Li, Chaofan, et autres
Publié: (2026)

DriveGen: Towards Infinite Diverse Traffic Scenarios with Large Models
par: Zhang, Shenyu, et autres
Publié: (2025)

Large Language Models for Extrapolative Modeling of Manufacturing Processes
par: Khanghah, Kiarash Naghavi, et autres
Publié: (2025)

A Unified XAI-LLM Approach for EndotrachealSuctioning Activity Recognition
par: Phan, Hoang Khang, et autres
Publié: (2026)