Cover Image

Surprise! Uniform Information Density Isn't the Whole Story: Predicting Surprisal Contours in Long-form Discourse

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tsipidi, Eleftheria, Nowak, Franz, Cotterell, Ryan, Wilcox, Ethan, Giulianelli, Mario, Warstadt, Alex
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Harmonic Structure of Information Contours
by: Tsipidi, Eleftheria, et al.
Published: (2025)

Testing the Predictions of Surprisal Theory in 11 Languages
by: Wilcox, Ethan Gotlieb, et al.
Published: (2023)

Probing for Reading Times
by: Tsipidi, Eleftheria, et al.
Published: (2026)

Towards a Similarity-adjusted Surprisal Theory
by: Meister, Clara, et al.
Published: (2024)

Surprisal Minimisation over Goal-directed Alternatives Predicts Production Choice in Dialogue
by: Utting, Tom, et al.
Published: (2026)

Is Information Density Uniform when Utterances are Grounded on Perception and Discourse?
by: Gay, Matteo, et al.
Published: (2026)

On the Proper Treatment of Units in Surprisal Theory
by: Kiegeland, Samuel, et al.
Published: (2026)

A Distributional Perspective on Word Learning in Neural Language Models
by: Ficarra, Filippo, et al.
Published: (2025)

Generalized Measures of Anticipation and Responsivity in Online Language Processing
by: Giulianelli, Mario, et al.
Published: (2024)

A Fast Algorithm for Computing Prefix Probabilities
by: Nowak, Franz, et al.
Published: (2023)

Investigating Critical Period Effects in Language Acquisition through Neural Language Models
by: Constantinescu, Ionut, et al.
Published: (2024)

On the Role of Context in Reading Time Prediction
by: Opedal, Andreas, et al.
Published: (2024)

If It Isn't Broken...Break It!
by: Voges, Mickie A.
Published: (2000)

Dual Alignment Between Language Model Layers and Human Sentence Processing
by: Kuribayashi, Tatsuki, et al.
Published: (2026)

What Do Prosody and Text Convey? Characterizing How Meaningful Information is Distributed Across Multiple Channels
by: Yadavalli, Aditya, et al.
Published: (2025)

The Surprising Effectiveness of Linear Models for Whole-Body Model-Predictive Control
by: Bishop, Arun L., et al.
Published: (2025)

An Algebraic View of the Expressivity of Recurrent Language Models
by: Nowak, Franz, et al.
Published: (2026)

The Universe Isn't Expanding, It's Relaxing
by: Blouin, Sam
Published: (2025)

The Universe Isn't Expanding — It's Relaxing
by: Blouin, Sam
Published: (2025)

AI Isn't Creating Anything
by: Lee Skallerup Bessette
Published: (2025)

Videodiscs: A Revolution That Isn't.
Published: (1982)

When Trust Isn't Enough.
by: Behrman, Sara
Published: (1998)

AI Isn't Creating Anything
by: Lee Skallerup Bessette
Published: (2025)

Touch Tablet Surprises: A Preschool Teacher's Story
by: Shifflet, Rena, et al.
Published: (2012)

Towards Developmentally Plausible Rewards: Communicative Success as a Learning Signal for Interactive Language Models
by: Stöpler, Lennart, et al.
Published: (2025)

Can Language Models Learn Typologically Implausible Languages?
by: Xu, Tianyang, et al.
Published: (2025)

Inverse Scaling: When Bigger Isn't Better
by: McKenzie, Ian R., et al.
Published: (2023)

ML Interpretability: Simple Isn't Easy
by: Räz, Tim
Published: (2022)

"Just Say No" Isn't Sex Education.
by: Osborn, Anne
Published: (1991)

Beyond Surprise: Improving Exploration Through Surprise Novelty
by: Le, Hung, et al.
Published: (2023)

Word Boundary Information Isn't Useful for Encoder Language Models
by: Gow-Smith, Edward, et al.
Published: (2024)

FinCall-Surprise: A Large Scale Multi-modal Benchmark for Earning Surprise Prediction
by: Shu, Dong, et al.
Published: (2025)

Langwarrin Surprises
by: Standen, Roger
Published: (2022)

Mathematical Surprises
by: Ben-Ari, Mordechai
Published: (2022)

The Surprise Economy

October Surprises
by: The Editors
Published: (2016)

Professional Surprise
by: Holland, George Adam
Published: (2006)

[Call for Papers] The 2nd BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpus
by: Choshen, Leshem, et al.
Published: (2024)

Causal Inference Isn't Special: Why It's Just Another Prediction Problem
by: Fernández-Loría, Carlos
Published: (2025)

The Newberys: Getting Them Read (It Isn't Easy)
by: Aborne, Carlene
Published: (1974)