Copertina

Classifier Context Rot: Monitor Performance Degrades with Context Length

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Martin, Sam, Roger, Fabien
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

How Useful Is Cross-Domain Generalization for Training LLM Monitors?
di: Martin, Sam, et al.
Pubblicazione: (2026)

Context Discipline and Performance Correlation: Analyzing LLM Performance and Quality Degradation Under Varying Context Lengths
di: Ponnusamy, Ahilan Ayyachamy Nadar, et al.
Pubblicazione: (2025)

Understanding LLM Performance Degradation in Multi-Instance Processing: The Roles of Instance Count and Context Length
di: Chen, Jingxuan, et al.
Pubblicazione: (2026)

The $\mathbf{Y}$-Combinator for LLMs: Solving Long-Context Rot with $λ$-Calculus
di: Roy, Amartya, et al.
Pubblicazione: (2026)

Context Length Alone Hurts LLM Performance Despite Perfect Retrieval
di: Du, Yufeng, et al.
Pubblicazione: (2025)

Excess Description Length of Learning Generalizable Predictors
di: Donoway, Elizabeth, et al.
Pubblicazione: (2026)

Context-Length Robustness in Question Answering Models: A Comparative Empirical Study
di: Dhara, Trishita, et al.
Pubblicazione: (2026)

Quantifying Laziness, Decoding Suboptimality, and Context Degradation in Large Language Models
di: Ma, Yiqing, et al.
Pubblicazione: (2025)

Self-Attribution Bias: When AI Monitors Go Easy on Themselves
di: Khullar, Dipika, et al.
Pubblicazione: (2026)

An Empirical Study on Context Length for Open-Domain Dialog Generation
di: Shen, Xinyi, et al.
Pubblicazione: (2024)

Resonance RoPE: Improving Context Length Generalization of Large Language Models
di: Wang, Suyuchen, et al.
Pubblicazione: (2024)

OWL: Overcoming Window Length-Dependence in Speculative Decoding for Long-Context Inputs
di: Lee, Jaeseong, et al.
Pubblicazione: (2025)

SLEIGHT-Bench: A Benchmark of Evasion Attacks Against Agent Monitors
di: Najt, Elle, et al.
Pubblicazione: (2026)

PictSure: Pretraining Embeddings Matters for In-Context Learning Image Classifiers
di: Schiesser, Lukas, et al.
Pubblicazione: (2025)

Games Are Not Equal: Classifying Cloud Gaming Contexts for Effective User Experience Measurement
di: Wang, Yifan, et al.
Pubblicazione: (2025)

An Evaluation of Context Length Extrapolation in Long Code via Positional Embeddings and Efficient Attention
di: Ghosh, Madhusudan, et al.
Pubblicazione: (2026)

Beyond Length: Context-Aware Expansion and Independence as Developmentally Sensitive Evaluation in Child Utterances
di: Chun, Jiyun, et al.
Pubblicazione: (2026)

Context Video Semantic Transmission with Variable Length and Rate Coding over MIMO Channels
di: Xie, Bingyan, et al.
Pubblicazione: (2025)

InftyThink: Breaking the Length Limits of Long-Context Reasoning in Large Language Models
di: Yan, Yuchen, et al.
Pubblicazione: (2025)

Efficient Length-Generalizable Attention via Causal Retrieval for Long-Context Language Modeling
di: Hu, Xiang, et al.
Pubblicazione: (2024)

Correlation-Aware Select and Merge Attention for Efficient Fine-Tuning and Context Length Extension
di: Wang, Ning, et al.
Pubblicazione: (2024)

Context Collapse: In-Context Learning and Model Collapse
di: Ott, Josef
Pubblicazione: (2026)

Can Custom Models Learn In-Context? An Exploration of Hybrid Architecture Performance on In-Context Learning Tasks
di: Campbell, Ryan, et al.
Pubblicazione: (2024)

Rethinking Zero-Shot Time Series Classification: From Task-specific Classifiers to In-Context Inference
di: Fang, Juntao, et al.
Pubblicazione: (2026)

Context Engineering 2.0: The Context of Context Engineering
di: Hua, Qishuo, et al.
Pubblicazione: (2025)

ConTextTab: A Semantics-Aware Tabular In-Context Learner
di: Spinaci, Marco, et al.
Pubblicazione: (2025)

Narrow Secret Loyalty Dodges Black-Box Audits
di: Lamerton, Alfie, et al.
Pubblicazione: (2026)

UltraLLaDA: Scaling the Context Length to 128K for Diffusion Large Language Models
di: He, Guangxin, et al.
Pubblicazione: (2025)

LongSkywork: A Training Recipe for Efficiently Extending Context Length in Large Language Models
di: Zhao, Liang, et al.
Pubblicazione: (2024)

ContextNav: Towards Agentic Multimodal In-Context Learning
di: Fu, Honghao, et al.
Pubblicazione: (2025)

Context-Aware Initialization for Reducing Generative Path Length in Diffusion Language Models
di: Miao, Tongyuan, et al.
Pubblicazione: (2025)

Can an LLM Induce a Graph? Investigating Memory Drift and Context Length
di: Yousuf, Raquib Bin, et al.
Pubblicazione: (2025)

Context Graph
di: Xu, Chengjin, et al.
Pubblicazione: (2024)

A Study on Context Length and Efficient Transformers for Biomedical Image Analysis
di: Hooper, Sarah M., et al.
Pubblicazione: (2024)

GIRAFFE: Design Choices for Extending the Context Length of Visual Language Models
di: Li, Mukai, et al.
Pubblicazione: (2024)

Towards a Holistic and Automated Evaluation Framework for Multi-Level Comprehension of LLMs in Book-Length Contexts
di: Deng, Jiaqi, et al.
Pubblicazione: (2025)

DeepContext: A Context-aware, Cross-platform, and Cross-framework Tool for Performance Profiling and Analysis of Deep Learning Workloads
di: Zhao, Qidong, et al.
Pubblicazione: (2024)

GSM-Infinite: How Do Your LLMs Behave over Infinitely Increasing Context Length and Reasoning Complexity?
di: Zhou, Yang, et al.
Pubblicazione: (2025)

Information Fidelity in Tool-Using LLM Agents: A Martingale Analysis of the Model Context Protocol
di: Fan, Flint Xiaofeng, et al.
Pubblicazione: (2026)

Context Memorization for Efficient Long Context Generation
di: Okoshi, Yasuyuki, et al.
Pubblicazione: (2026)