Cover Image

Generalized Measures of Anticipation and Responsivity in Online Language Processing

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Giulianelli, Mario, Opedal, Andreas, Cotterell, Ryan
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Spatio-Temporal Point Process for Fine-Grained Modeling of Reading Behavior
by: Re, Francesco Ignazio, et al.
Published: (2025)

Transformers Can Represent $n$-gram Language Models
by: Svete, Anej, et al.
Published: (2024)

LLM Agents in Interaction: Measuring Personality Consistency and Linguistic Alignment in Interacting Populations of Large Language Models
by: Frisch, Ivar, et al.
Published: (2024)

Learning to Reason Efficiently with A* Post-Training
by: Opedal, Andreas, et al.
Published: (2026)

Do Language Models Exhibit the Same Cognitive Biases in Problem Solving as Human Learners?
by: Opedal, Andreas, et al.
Published: (2024)

From Language Models over Tokens to Language Models over Characters
by: Vieira, Tim, et al.
Published: (2024)

Slaves to the Law of Large Numbers: An Asymptotic Equipartition Property for Perplexity in Generative Language Models
by: Bell, Tyler, et al.
Published: (2024)

Are Language Models Efficient Reasoners? A Perspective from Logic Programming
by: Opedal, Andreas, et al.
Published: (2025)

Measuring Information Distortion in Hierarchical Ultra long Novel Reconstruction:The Optimal Expansion Ratio
by: Shen, Hanwen, et al.
Published: (2025)

Cross-Entropy Games for Language Models: From Implicit Knowledge to General Capability Measures
by: Hongler, Clément, et al.
Published: (2025)

Large Language Models as Evaluators for Scientific Synthesis
by: Evans, Julia, et al.
Published: (2024)

Task-Centric Acceleration of Small-Language Models
by: Tsur, Dor, et al.
Published: (2026)

Conversational Complexity for Assessing Risk in Large Language Models
by: Burden, John, et al.
Published: (2024)

Prefix Parsing is Just Parsing
by: Pasti, Clemente, et al.
Published: (2026)

Robust AI-Generated Text Detection by Restricted Embeddings
by: Kuznetsov, Kristian, et al.
Published: (2024)

Evaluating Large Language Models for Structured Science Summarization in the Open Research Knowledge Graph
by: Nechakhin, Vladyslav, et al.
Published: (2024)

A Distributional Perspective on Word Learning in Neural Language Models
by: Ficarra, Filippo, et al.
Published: (2025)

Towards Explainability in Legal Outcome Prediction Models
by: Valvoda, Josef, et al.
Published: (2024)

Revisiting Padded Transformer Expressivity: Which Architectural Choices Matter and Which Don't
by: Svete, Anej, et al.
Published: (2026)

Measuring Uncertainty in Transformer Circuits with Effective Information Consistency
by: Krasnovsky, Anatoly A.
Published: (2025)

Enhancing Retrieval Processes for Language Generation with Augmented Queries
by: Ghali, Julien Pierre Edmond, et al.
Published: (2024)

Gumbel Counterfactual Generation From Language Models
by: Ravfogel, Shauli, et al.
Published: (2024)

SPARQL Query Generation with LLMs: Measuring the Impact of Training Data Memorization and Knowledge Injection
by: Gashkov, Aleksandr, et al.
Published: (2025)

Language Modeling Is Compression
by: Delétang, Grégoire, et al.
Published: (2023)

Astro-NER -- Astronomy Named Entity Recognition: Is GPT a Good Domain Expert Annotator?
by: Evans, Julia, et al.
Published: (2024)

An Information-Theoretic Approach to Analyze NLP Classification Tasks
by: Wang, Luran, et al.
Published: (2024)

From Tokens to Thoughts: How LLMs and Humans Trade Compression for Meaning
by: Shani, Chen, et al.
Published: (2025)

Test-Time Steering for Lossless Text Compression via Weighted Product of Experts
by: Zhang, Qihang, et al.
Published: (2025)

Surprisal and Metaphor Novelty Judgments: Moderate Correlations and Divergent Scaling Effects Revealed by Corpus-Based and Synthetic Datasets
by: Momen, Omar, et al.
Published: (2026)

On Theoretical Interpretations of Concept-Based In-Context Learning
by: Tang, Huaze, et al.
Published: (2025)

Graph-Enhanced Retrieval-Augmented Question Answering for E-Commerce Customer Support
by: Patel, Piyushkumar
Published: (2025)

LogitScope: A Framework for Analyzing LLM Uncertainty Through Information Metrics
by: Ahmed, Farhan, et al.
Published: (2026)

Complexity Agnostic Recursive Decomposition of Thoughts
by: Qasim, Kaleem Ullah, et al.
Published: (2025)

Think or Not? Exploring Thinking Efficiency in Large Reasoning Models via an Information-Theoretic Lens
by: Yong, Xixian, et al.
Published: (2025)

On the Reasoning Capacity of AI Models and How to Quantify It
by: Radha, Santosh Kumar, et al.
Published: (2025)

Seq2Seq2Seq: Lossless Data Compression via Discrete Latent Transformers and Reinforcement Learning
by: Khodabandeh, Mahdi, et al.
Published: (2026)

Riddle Quest : The Enigma of Words
by: Parasa, Niharika Sri, et al.
Published: (2026)

The Information of Large Language Model Geometry
by: Tan, Zhiquan, et al.
Published: (2024)

Better Estimation of the Kullback--Leibler Divergence Between Language Models
by: Amini, Afra, et al.
Published: (2025)

Memorization-Compression Cycles Improve Generalization
by: Yu, Fangyuan
Published: (2025)