Imagen de Portada

RULER: What's the Real Context Size of Your Long-Context Language Models?

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Hsieh, Cheng-Ping, Sun, Simeng, Kriman, Samuel, Acharya, Shantanu, Rekesh, Dima, Jia, Fei, Zhang, Yang, Ginsburg, Boris
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

SWAN-GPT: An Efficient and Scalable Approach for Long-Context Language Modeling
por: Puvvada, Krishna C., et al.
Publicado: (2025)

Star Attention: Efficient LLM Inference over Long Sequences
por: Acharya, Shantanu, et al.
Publicado: (2024)

L0-Reasoning Bench: Evaluating Procedural Correctness in Language Models via Simple Program Execution
por: Sun, Simeng, et al.
Publicado: (2025)

How much do contextualized representations encode long-range context?
por: Sun, Simeng, et al.
Publicado: (2024)

nGPT: Normalized Transformer with Representation Learning on the Hypersphere
por: Loshchilov, Ilya, et al.
Publicado: (2024)

Readme_AI: Dynamic Context Construction for Large Language Models
por: Vyas, Millie, et al.
Publicado: (2025)

A Controllable Examination for Long-Context Language Models
por: Yang, Yijun, et al.
Publicado: (2025)

Blinded by Generated Contexts: How Language Models Merge Generated and Retrieved Contexts When Knowledge Conflicts?
por: Tan, Hexiang, et al.
Publicado: (2024)

Revisiting In-Context Learning with Long Context Language Models
por: Baek, Jinheon, et al.
Publicado: (2024)

Measuring text summarization factuality using atomic facts entailment metrics in the context of retrieval augmented generation
por: Kriman, N. E.
Publicado: (2024)

Long-Context Language Modeling with Parallel Context Encoding
por: Yen, Howard, et al.
Publicado: (2024)

CCF: A Context Compression Framework for Efficient Long-Sequence Language Modeling
por: Li, Wenhao, et al.
Publicado: (2025)

Training-Free Long-Context Scaling of Large Language Models
por: An, Chenxin, et al.
Publicado: (2024)

NGPU-LM: GPU-Accelerated N-Gram Language Model for Context-Biasing in Greedy ASR Decoding
por: Bataev, Vladimir, et al.
Publicado: (2025)

FltLM: An Intergrated Long-Context Large Language Model for Effective Context Filtering and Understanding
por: Deng, Jingyang, et al.
Publicado: (2024)

SPELL: Self-Play Reinforcement Learning for Evolving Long-Context Language Models
por: Yang, Ziyi, et al.
Publicado: (2025)

Bootstrap Your Own Context Length
por: Wang, Liang, et al.
Publicado: (2024)

LooGLE: Can Long-Context Language Models Understand Long Contexts?
por: Li, Jiaqi, et al.
Publicado: (2023)

Transducers with Pronunciation-aware Embeddings for Automatic Speech Recognition
por: Xu, Hainan, et al.
Publicado: (2024)

TurboBias: Universal ASR Context-Biasing powered by GPU-accelerated Phrase-Boosting Tree
por: Andrusenko, Andrei, et al.
Publicado: (2025)

An empirical study on the limitation of Transformers in program trace generation
por: Sun, Simeng
Publicado: (2025)

Core Context Aware Transformers for Long Context Language Modeling
por: Chen, Yaofo, et al.
Publicado: (2024)

Fast Context-Biasing for CTC and Transducer ASR models with CTC-based Word Spotter
por: Andrusenko, Andrei, et al.
Publicado: (2024)

LLM Ensemble for RAG: Role of Context Length in Zero-Shot Question Answering for BioASQ Challenge
por: Galat, Dima, et al.
Publicado: (2025)

PEEK: Context Map as an Orientation Cache for Long-Context LLM Agents
por: Gu, Zhuohan, et al.
Publicado: (2026)

How Persuasive is Your Context?
por: Nguyen, Tu, et al.
Publicado: (2025)

What Kinds of Tokens Benefit from Distant Text? An Analysis on Long Context Language Modeling
por: Hu, Yutong, et al.
Publicado: (2024)

How to Train Your Long-Context Visual Document Model
por: Veselka, Austin
Publicado: (2026)

Membership Inference Attack against Long-Context Large Language Models
por: Wang, Zixiong, et al.
Publicado: (2024)

CAPE: Context-Aware Personality Evaluation Framework for Large Language Models
por: Sandhan, Jivnesh, et al.
Publicado: (2025)

Gated Differentiable Working Memory for Long-Context Language Modeling
por: Mei, Lingrui, et al.
Publicado: (2026)

Mixture of In-Context Experts Enhance LLMs' Long Context Awareness
por: Lin, Hongzhan, et al.
Publicado: (2024)

LongSafety: Evaluating Long-Context Safety of Large Language Models
por: Lu, Yida, et al.
Publicado: (2025)

HERA: Improving Long Document Summarization using Large Language Models with Context Packaging and Reordering
por: Li, Taiji, et al.
Publicado: (2025)

SoLoPO: Unlocking Long-Context Capabilities in LLMs via Short-to-Long Preference Optimization
por: Sun, Huashan, et al.
Publicado: (2025)

LongReason: A Synthetic Long-Context Reasoning Benchmark via Context Expansion
por: Ling, Zhan, et al.
Publicado: (2025)

Do Reasoning LLMs Refuse What They Infer in Long Contexts?
por: Fu, Yu, et al.
Publicado: (2026)

Long Context is Not Long at All: A Prospector of Long-Dependency Data for Large Language Models
por: Chen, Longze, et al.
Publicado: (2024)

Chain of Agents: Large Language Models Collaborating on Long-Context Tasks
por: Zhang, Yusen, et al.
Publicado: (2024)

Context as a Tool: Context Management for Long-Horizon SWE-Agents
por: Liu, Shukai, et al.
Publicado: (2025)