Cover Image

Linguistic Structure from a Bottleneck on Sequential Information Processing

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Futrell, Richard, Hahn, Michael
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

An information-theoretic model of shallow and deep language comprehension
by: Li, Jiaxuan, et al.
Published: (2024)

Decomposition of surprisal: Unified computational model of ERP components in language processing
by: Li, Jiaxuan, et al.
Published: (2024)

Clarifying orthography: Orthographic transparency as compressibility
by: Torres, Charles J., et al.
Published: (2025)

How Linguistics Learned to Stop Worrying and Love the Language Models
by: Futrell, Richard, et al.
Published: (2025)

Explainable Recommender with Geometric Information Bottleneck
by: Yan, Hanqi, et al.
Published: (2023)

Information Theory of Meaningful Communication
by: Sivan, Doron, et al.
Published: (2024)

A hierarchical Bayesian model for syntactic priming
by: Xu, Weijie, et al.
Published: (2024)

Strategic resource allocation in memory encoding: An efficiency principle shaping language processing
by: Xu, Weijie, et al.
Published: (2025)

You Can't Fight in Here! This is BBS!
by: Futrell, Richard, et al.
Published: (2026)

Back to the Future: The Role of Past and Future Context Predictability in Incremental Language Production
by: Upadhye, Shiva, et al.
Published: (2025)

TexShape: Information Theoretic Sentence Embedding for Language Models
by: Kale, Kaan, et al.
Published: (2024)

HILL: Hierarchy-aware Information Lossless Contrastive Learning for Hierarchical Text Classification
by: Zhu, He, et al.
Published: (2024)

Generalized Measures of Anticipation and Responsivity in Online Language Processing
by: Giulianelli, Mario, et al.
Published: (2024)

Information-Theoretic Generative Clustering of Documents
by: Du, Xin, et al.
Published: (2024)

HRGraph: Leveraging LLMs for HR Data Knowledge Graphs with Information Propagation-based Job Recommendation
by: Wasi, Azmine Toushik
Published: (2024)

Measuring Grammatical Diversity from Small Corpora: Derivational Entropy Rates, Mean Length of Utterances, and Annotation Invariance
by: Martin, Fermin Moscoso del Prado
Published: (2024)

SPACER: A Parallel Dataset of Speech Production And Comprehension of Error Repairs
by: Upadhye, Shiva, et al.
Published: (2025)

Linguistic and Structural Basis of Engineering Design Knowledge
by: Siddharth, L., et al.
Published: (2023)

An Information-Theoretic Approach to Analyze NLP Classification Tasks
by: Wang, Luran, et al.
Published: (2024)

Evaluating Large Language Models for Structured Science Summarization in the Open Research Knowledge Graph
by: Nechakhin, Vladyslav, et al.
Published: (2024)

Exploring the Sensitivity of LLMs' Decision-Making Capabilities: Insights from Prompt Variation and Hyperparameters
by: Loya, Manikanta, et al.
Published: (2023)

Agent-based imitation dynamics can yield efficiently compressed population-level vocabularies
by: Imel, Nathaniel, et al.
Published: (2026)

An Information-theoretic Multi-task Representation Learning Framework for Natural Language Understanding
by: Hu, Dou, et al.
Published: (2025)

LogitScope: A Framework for Analyzing LLM Uncertainty Through Information Metrics
by: Ahmed, Farhan, et al.
Published: (2026)

MEG-RAG: Quantifying Multi-modal Evidence Grounding for Evidence Selection in RAG
by: Wang, Xihang, et al.
Published: (2026)

Measuring Information Distortion in Hierarchical Ultra long Novel Reconstruction:The Optimal Expansion Ratio
by: Shen, Hanwen, et al.
Published: (2025)

Think or Not? Exploring Thinking Efficiency in Large Reasoning Models via an Information-Theoretic Lens
by: Yong, Xixian, et al.
Published: (2025)

Quantification and Validation for Degree of Understanding in M2M Semantic Communications
by: Xia, Linhan, et al.
Published: (2024)

A geometric framework for interstellar discourse on fundamental physical structures
by: Esposito, Giampiero, et al.
Published: (2024)

Quantifying the perceptual value of lexical and non-lexical channels in speech
by: Wallbridge, Sarenne, et al.
Published: (2023)

When Efficient Communication Explains Convexity
by: Ranjan, Ashvin, et al.
Published: (2026)

The optimality of word lengths. Theoretical foundations and an empirical study
by: Petrini, Sonia, et al.
Published: (2022)

Speculative Sampling via Exponential Races
by: Kobus, Szymon, et al.
Published: (2025)

Nacrith: Neural Lossless Compression via Ensemble Context Modeling and High-Precision CDF Coding
by: Tacconelli, Roberto
Published: (2026)

The Emergence of Grammar through Reinforcement Learning
by: Wechsler, Stephen, et al.
Published: (2025)

Feature-Level Insights into Artificial Text Detection with Sparse Autoencoders
by: Kuznetsov, Kristian, et al.
Published: (2025)

The time scale of redundancy between prosody and linguistic context
by: Regev, Tamar I., et al.
Published: (2025)

Optimal Multi-bit Generative Watermarking Schemes Under Worst-Case False-Alarm Constraints
by: Huang, Yu-Shin, et al.
Published: (2026)

Common TF-IDF variants arise as key components in the test statistic of a penalized likelihood-ratio test for word burstiness
by: Ahmed, Zeyad, et al.
Published: (2026)

Structured IB: Improving Information Bottleneck with Structured Feature Learning
by: Yang, Hanzhe, et al.
Published: (2024)