Image de couverture de livre

The Need for an External Observer Formalizing the Sufficiency Gap: A Mathematical Extension of Mixture Identifiability and Contextual Grounding in Sequence Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Corielli, Francesco
Format:	Preprint
Publié:	2026
Sujets:	Computation and Language Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

When Is Next-Token Prediction Useful? Marginalization, Ergodicity, Mixture Identifiability, Local Sufficiency, RAG, Tools, and Programming
par: Corielli, Francesco
Publié: (2026)

Is Random Attention Sufficient for Sequence Modeling? Disentangling Trainable Components in the Transformer
par: Dong, Yihe, et autres
Publié: (2025)

No Need to Talk: Asynchronous Mixture of Language Models
par: Filippova, Anastasiia, et autres
Publié: (2024)

Neural Sequence-to-Sequence Modeling with Attention by Leveraging Deep Learning Architectures for Enhanced Contextual Understanding in Abstractive Text Summarization
par: Challagundla, Bhavith Chandra, et autres
Publié: (2024)

Meta-DiffuB: A Contextualized Sequence-to-Sequence Text Diffusion Model with Meta-Exploration
par: Chuang, Yun-Yen, et autres
Publié: (2024)

Necessary and Sufficient Watermark for Large Language Models
par: Takezawa, Yuki, et autres
Publié: (2023)

MoM: Linear Sequence Modeling with Mixture-of-Memories
par: Du, Jusen, et autres
Publié: (2025)

Is In-Context Learning Sufficient for Instruction Following in LLMs?
par: Zhao, Hao, et autres
Publié: (2024)

Uncertainty as Feature Gaps: Epistemic Uncertainty Quantification of LLMs in Contextual Question-Answering
par: Bakman, Yavuz, et autres
Publié: (2025)

Do We Need Frontier Models to Verify Mathematical Proofs?
par: Naik, Aaditya, et autres
Publié: (2026)

Outcome-Grounded Advantage Reshaping for Fine-Grained Credit Assignment in Mathematical Reasoning
par: Li, Ziheng, et autres
Publié: (2026)

DRA-GRPO: Your GRPO Needs to Know Diverse Reasoning Paths for Mathematical Reasoning
par: Chen, Xiwen, et autres
Publié: (2025)

Identifying Factual Inconsistencies in Summaries: Grounding LLM Inference via Task Taxonomy
par: Xu, Liyan, et autres
Publié: (2024)

ProcessBench: Identifying Process Errors in Mathematical Reasoning
par: Zheng, Chujie, et autres
Publié: (2024)

Safe: Enhancing Mathematical Reasoning in Large Language Models via Retrospective Step-aware Formal Verification
par: Liu, Chengwu, et autres
Publié: (2025)

Optimizing Pre-Training Data Mixtures with Mixtures of Data Expert Models
par: Belenki, Lior, et autres
Publié: (2025)

Contextual Text Denoising with Masked Language Models
par: Sun, Yifu, et autres
Publié: (2019)

Is Next Token Prediction Sufficient for GPT? Exploration on Code Logic Comprehension
par: Qi, Mengnan, et autres
Publié: (2024)

Solving Situation Puzzles with Large Language Model and External Reformulation
par: Li, Kun, et autres
Publié: (2025)

A Survey on Mixture of Experts in Large Language Models
par: Cai, Weilin, et autres
Publié: (2024)

CEMTM: Contextual Embedding-based Multimodal Topic Modeling
par: Abaskohi, Amirhossein, et autres
Publié: (2025)

A Single Neuron Is Sufficient to Bypass Safety Alignment in Large Language Models
par: Kazemi, Hamid, et autres
Publié: (2026)

$K$-MSHC: Unmasking Minimally Sufficient Head Circuits in Large Language Models with Experiments on Syntactic Classification Tasks
par: Chowdhary, Pratim, et autres
Publié: (2025)

On the "Induction Bias" in Sequence Models
par: Ebrahimi, M. Reza, et autres
Publié: (2026)

Linear-MoE: Linear Sequence Modeling Meets Mixture-of-Experts
par: Sun, Weigao, et autres
Publié: (2025)

A Closer Look into Mixture-of-Experts in Large Language Models
par: Lo, Ka Man, et autres
Publié: (2024)

Estimating Privacy Leakage of Augmented Contextual Knowledge in Language Models
par: Flemings, James, et autres
Publié: (2024)

CATS: Contextually-Aware Thresholding for Sparsity in Large Language Models
par: Lee, Donghyun, et autres
Publié: (2024)

Bayesian Mixture of Experts For Large Language Models
par: Dialameh, Maryam, et autres
Publié: (2025)

Mixture-of-Personas Language Models for Population Simulation
par: Bui, Ngoc, et autres
Publié: (2025)

A Formal Framework for Uncertainty Analysis of Text Generation with Large Language Models
par: Herbold, Steffen, et autres
Publié: (2026)

On the Thinking-Language Modeling Gap in Large Language Models
par: Liu, Chenxi, et autres
Publié: (2025)

AWARE, Beyond Sentence Boundaries: A Contextual Transformer Framework for Identifying Cultural Capital in STEM Narratives
par: Khan, Khalid Mehtab, et autres
Publié: (2025)

Objective Metrics for Evaluating Large Language Models Using External Data Sources
par: Du, Haoze, et autres
Publié: (2025)

Transforming Chatbot Text: A Sequence-to-Sequence Approach
par: Reddy, Natesh, et autres
Publié: (2025)

Response-Level Rewards Are All You Need for Online Reinforcement Learning in LLMs: A Mathematical Perspective
par: He, Shenghua, et autres
Publié: (2025)

Learning to Reason without External Rewards
par: Zhao, Xuandong, et autres
Publié: (2025)

VEHME: A Vision-Language Model For Evaluating Handwritten Mathematics Expressions
par: Nguyen, Thu Phuong, et autres
Publié: (2025)

Attention Is All You Need But You Don't Need All Of It For Inference of Large Language Models
par: Tyukin, Georgy, et autres
Publié: (2024)

AMGPT: a Large Language Model for Contextual Querying in Additive Manufacturing
par: Chandrasekhar, Achuth, et autres
Publié: (2024)