Cover Image

Information Theory of Meaningful Communication

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sivan, Doron, Tsodyks, Misha
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Semantic Chunking and the Entropy of Natural Language
by: Zhong, Weishun, et al.
Published: (2026)

Random Tree Model of Meaningful Memory
by: Zhong, Weishun, et al.
Published: (2024)

Synaptic Theory of Chunking in Working Memory
by: Zhong, Weishun, et al.
Published: (2024)

Large-scale study of human memory for meaningful narratives
by: Georgiou, Antonios, et al.
Published: (2023)

When Efficient Communication Explains Convexity
by: Ranjan, Ashvin, et al.
Published: (2026)

Quantification and Validation for Degree of Understanding in M2M Semantic Communications
by: Xia, Linhan, et al.
Published: (2024)

TexShape: Information Theoretic Sentence Embedding for Language Models
by: Kale, Kaan, et al.
Published: (2024)

Linguistic Structure from a Bottleneck on Sequential Information Processing
by: Futrell, Richard, et al.
Published: (2024)

HILL: Hierarchy-aware Information Lossless Contrastive Learning for Hierarchical Text Classification
by: Zhu, He, et al.
Published: (2024)

Analyzing and Improving Chain-of-Thought Monitorability Through Information Theory
by: Anwar, Usman, et al.
Published: (2026)

A Mathematical Theory for Learning Semantic Languages by Abstract Learners
by: Liao, Kuo-Yu, et al.
Published: (2024)

Random Reed-Solomon Codes are List Recoverable with Optimal List Size
by: Doron, Dean, et al.
Published: (2024)

Information-Theoretic Generative Clustering of Documents
by: Du, Xin, et al.
Published: (2024)

RateQuant: Optimal Mixed-Precision KV Cache Quantization via Rate-Distortion Theory
by: Zuo, Fei, et al.
Published: (2026)

HRGraph: Leveraging LLMs for HR Data Knowledge Graphs with Information Propagation-based Job Recommendation
by: Wasi, Azmine Toushik
Published: (2024)

An Information-Theoretic Approach to Analyze NLP Classification Tasks
by: Wang, Luran, et al.
Published: (2024)

Modeling Probabilistic Reduction using Information Theory and Naive Discriminative Learning
by: Stein, Anna, et al.
Published: (2025)

An Information-theoretic Multi-task Representation Learning Framework for Natural Language Understanding
by: Hu, Dou, et al.
Published: (2025)

LogitScope: A Framework for Analyzing LLM Uncertainty Through Information Metrics
by: Ahmed, Farhan, et al.
Published: (2026)

MEG-RAG: Quantifying Multi-modal Evidence Grounding for Evidence Selection in RAG
by: Wang, Xihang, et al.
Published: (2026)

When Do Low-Rate Concatenated Codes Approach The Gilbert-Varshamov Bound?
by: Doron, Dean, et al.
Published: (2024)

Measuring Information Distortion in Hierarchical Ultra long Novel Reconstruction:The Optimal Expansion Ratio
by: Shen, Hanwen, et al.
Published: (2025)

Think or Not? Exploring Thinking Efficiency in Large Reasoning Models via an Information-Theoretic Lens
by: Yong, Xixian, et al.
Published: (2025)

A geometric framework for interstellar discourse on fundamental physical structures
by: Esposito, Giampiero, et al.
Published: (2024)

An information-theoretic model of shallow and deep language comprehension
by: Li, Jiaxuan, et al.
Published: (2024)

Decomposition of surprisal: Unified computational model of ERP components in language processing
by: Li, Jiaxuan, et al.
Published: (2024)

Clarifying orthography: Orthographic transparency as compressibility
by: Torres, Charles J., et al.
Published: (2025)

Quantifying the perceptual value of lexical and non-lexical channels in speech
by: Wallbridge, Sarenne, et al.
Published: (2023)

The optimality of word lengths. Theoretical foundations and an empirical study
by: Petrini, Sonia, et al.
Published: (2022)

Speculative Sampling via Exponential Races
by: Kobus, Szymon, et al.
Published: (2025)

Nacrith: Neural Lossless Compression via Ensemble Context Modeling and High-Precision CDF Coding
by: Tacconelli, Roberto
Published: (2026)

The Emergence of Grammar through Reinforcement Learning
by: Wechsler, Stephen, et al.
Published: (2025)

Feature-Level Insights into Artificial Text Detection with Sparse Autoencoders
by: Kuznetsov, Kristian, et al.
Published: (2025)

The time scale of redundancy between prosody and linguistic context
by: Regev, Tamar I., et al.
Published: (2025)

Optimal Multi-bit Generative Watermarking Schemes Under Worst-Case False-Alarm Constraints
by: Huang, Yu-Shin, et al.
Published: (2026)

Measuring Grammatical Diversity from Small Corpora: Derivational Entropy Rates, Mean Length of Utterances, and Annotation Invariance
by: Martin, Fermin Moscoso del Prado
Published: (2024)

Nearly-Linear Time Seeded Extractors with Short Seeds
by: Doron, Dean, et al.
Published: (2024)

Harmonizing Program Induction with Rate-Distortion Theory
by: Zhou, Hanqi, et al.
Published: (2024)

Integrating Pre-Trained Language Model with Physical Layer Communications
by: Lee, Ju-Hyung, et al.
Published: (2024)

A Communication-Theoretic Framework for LLM Agents: Cost-Aware Adaptive Reliability
by: Omidvar, Hamed, et al.
Published: (2026)