Cover Image

CLEX: Continuous Length Extrapolation for Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Guanzheng, Li, Xin, Meng, Zaiqiao, Liang, Shangsong, Bing, Lidong
Format:	Preprint
Published:	2023
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
by: Chen, Guanzheng, et al.
Published: (2025)

LongRLVR: Long-Context Reinforcement Learning Requires Verifiable Context Rewards
by: Chen, Guanzheng, et al.
Published: (2026)

I Know About "Up"! Enhancing Spatial Reasoning in Visual Language Models Through 3D Reconstruction
by: Meng, Zaiqiao, et al.
Published: (2024)

Speculative Reward Model Boosts Decision Making Ability of LLMs Cost-Effectively
by: Gu, Jiawei, et al.
Published: (2025)

Exploring the Potential of Large Language Models in Computational Argumentation
by: Chen, Guizhen, et al.
Published: (2023)

Multilingual Jailbreak Challenges in Large Language Models
by: Deng, Yue, et al.
Published: (2023)

Evaluating Psychological Safety of Large Language Models
by: Li, Xingxuan, et al.
Published: (2022)

SeaLLMs -- Large Language Models for Southeast Asia
by: Nguyen, Xuan-Phi, et al.
Published: (2023)

Length Extrapolation of Transformers: A Survey from the Perspective of Positional Encoding
by: Zhao, Liang, et al.
Published: (2023)

DAPE: Data-Adaptive Positional Encoding for Length Extrapolation
by: Zheng, Chuanyang, et al.
Published: (2024)

Pruning General Large Language Models into Customized Expert Models
by: Zhao, Yirao, et al.
Published: (2025)

LETToT: Label-Free Evaluation of Large Language Models On Tourism Using Expert Tree-of-Thought
by: Qi, Ruiyan, et al.
Published: (2025)

Exploring Mathematical Extrapolation of Large Language Models with Synthetic Data
by: Li, Haolong, et al.
Published: (2024)

Softplus Attention with Re-weighting Boosts Length Extrapolation in Large Language Models
by: Gao, Bo, et al.
Published: (2025)

How do Large Language Models Handle Multilingualism?
by: Zhao, Yiran, et al.
Published: (2024)

Towards Robust Temporal Reasoning of Large Language Models via a Multi-Hop QA Dataset and Pseudo-Instruction Tuning
by: Tan, Qingyu, et al.
Published: (2023)

VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs
by: Cheng, Zesen, et al.
Published: (2024)

AMR-Evol: Adaptive Modular Response Evolution Elicits Better Knowledge Distillation for Large Language Models in Code Generation
by: Luo, Ziyang, et al.
Published: (2024)

Large Language Models can Contrastively Refine their Generation for Better Sentence Representation Learning
by: Wang, Huiming, et al.
Published: (2023)

Context-aware Biases for Length Extrapolation
by: Veisi, Ali, et al.
Published: (2025)

D-SCoRE: Document-Centric Segmentation and CoT Reasoning with Structured Export for QA-CoT Data Generation
by: Zhou, Weibo, et al.
Published: (2025)

LLM-R2: A Large Language Model Enhanced Rule-based Rewrite System for Boosting Query Efficiency
by: Li, Zhaodonghui, et al.
Published: (2024)

DAPE V2: Process Attention Score as Feature Map for Length Extrapolation
by: Zheng, Chuanyang, et al.
Published: (2024)

Unlocking Temporal Question Answering for Large Language Models with Tailor-Made Reasoning Logic
by: Li, Xingxuan, et al.
Published: (2023)

Is Translation All You Need? A Study on Solving Multilingual Tasks with Large Language Models
by: Liu, Chaoqun, et al.
Published: (2024)

Time to Revist Exact Match
by: Abbood, Auss, et al.
Published: (2025)

Attention Instruction: Amplifying Attention in the Middle via Prompting
by: Zhang, Meiru, et al.
Published: (2024)

KiRAG: Knowledge-Driven Iterative Retriever for Enhancing Retrieval-Augmented Generation
by: Fang, Jinyuan, et al.
Published: (2025)

Information Entropy Invariance: Enhancing Length Extrapolation in Attention Mechanisms
by: Li, Kewei, et al.
Published: (2025)

Large Language Models for Extrapolative Modeling of Manufacturing Processes
by: Khanghah, Kiarash Naghavi, et al.
Published: (2025)

AdaMergeX: Cross-Lingual Transfer with Large Language Models via Adaptive Adapter Merging
by: Zhao, Yiran, et al.
Published: (2024)

Effective Length Extrapolation via Dimension-Wise Positional Embeddings Manipulation
by: Lu, Yi, et al.
Published: (2025)

Extrapolation by Association: Length Generalization Transfer in Transformers
by: Cai, Ziyang, et al.
Published: (2025)

Efficient Temporal Extrapolation of Multimodal Large Language Models with Temporal Grounding Bridge
by: Wang, Yuxuan, et al.
Published: (2024)

Chain-of-Knowledge: Grounding Large Language Models via Dynamic Knowledge Adapting over Heterogeneous Sources
by: Li, Xingxuan, et al.
Published: (2023)

Document Reconstruction Unlocks Scalable Long-Context RLVR
by: Xiao, Yao, et al.
Published: (2026)

Large Language Models as Interpolated and Extrapolated Event Predictors
by: Zhang, Libo, et al.
Published: (2024)

TRACE the Evidence: Constructing Knowledge-Grounded Reasoning Chains for Retrieval-Augmented Generation
by: Fang, Jinyuan, et al.
Published: (2024)

ParallelComp: Parallel Long-Context Compressor for Length Extrapolation
by: Xiong, Jing, et al.
Published: (2025)

Entropy Guided Extrapolative Decoding to Improve Factuality in Large Language Models
by: Das, Souvik, et al.
Published: (2024)