:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Author:	Zenil, Hector
Format:	Preprint
Published:	2026
Subjects:	Information Theory Artificial Intelligence Machine Learning
Online Access:	https://arxiv.org/abs/2601.05280
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Neural Networks Learn Generic Multi-Index Models Near Information-Theoretic Limit
by: Zhang, Bohan, et al.
Published: (2025)

PROPS: Progressively Private Self-alignment of Large Language Models
by: Teku, Noel, et al.
Published: (2025)

Large Language Models for Telecom: Forthcoming Impact on the Industry
by: Maatouk, Ali, et al.
Published: (2023)

WDMoE: Wireless Distributed Large Language Models with Mixture of Experts
by: Xue, Nan, et al.
Published: (2024)

Tele-LLMs: A Series of Specialized Large Language Models for Telecommunications
by: Maatouk, Ali, et al.
Published: (2024)

ISR: Invertible Symbolic Regression
by: Tohme, Tony, et al.
Published: (2024)

The Information of Large Language Model Geometry
by: Tan, Zhiquan, et al.
Published: (2024)

General Information Metrics for Improving AI Model Training Efficiency
by: Xu, Jianfeng, et al.
Published: (2025)

Curvature-Weighted Capacity Allocation: A Minimum Description Length Framework for Layer-Adaptive Large Language Model Optimization
by: Amaefuna, Theophilus, et al.
Published: (2026)

An Optimal, Universal and Agnostic Decoding Method for Message Reconstruction, Bio and Technosignature Detection
by: Zenil, Hector, et al.
Published: (2023)

Diffusion Model-Based Data Synthesis Aided Federated Semi-Supervised Learning
by: Wang, Zhongwei, et al.
Published: (2025)

A Survey on Large Language Models from Concept to Implementation
by: Wang, Chen, et al.
Published: (2024)

Confidence-Based Decoding is Provably Efficient for Diffusion Language Models
by: Cai, Changxiao, et al.
Published: (2026)

Beyond Rebalancing: Benchmarking Binary Classifiers Under Class Imbalance Without Rebalancing Techniques
by: Nawaz, Ali, et al.
Published: (2025)

Thermodynamic Limits of Physical Intelligence
by: Takahashi, Koichi, et al.
Published: (2026)

Know Your Limits: Entropy Estimation Modeling for Compression and Generalization
by: Badger, Benjamin L., et al.
Published: (2025)

Can Complexity and Uncomputability Explain Intelligence? SuperARC: A Test for Artificial Super Intelligence Based on Recursive Compression
by: Hernández-Espinosa, Alberto, et al.
Published: (2025)

MESSY Estimation: Maximum-Entropy based Stochastic and Symbolic densitY Estimation
by: Tohme, Tony, et al.
Published: (2023)

Diff-eRank: A Novel Rank-Based Metric for Evaluating Large Language Models
by: Wei, Lai, et al.
Published: (2024)

Semantic Text Transmission via Prediction with Small Language Models: Cost-Similarity Trade-off
by: Madhabhavi, Bhavani A, et al.
Published: (2024)

Language Modeling Is Compression
by: Delétang, Grégoire, et al.
Published: (2023)

Polynomial Context-Truncation Sensitivity in Autoregressive Language Models: Sequential Wyner-Ziv Bounds for KV Cache Compression
by: Kim, Munsik
Published: (2026)

Beyond the Loss Curve: Scaling Laws, Active Learning, and the Limits of Learning from Exact Posteriors
by: Khorasani, Arian, et al.
Published: (2026)

An Information-Theoretic Criterion for Efficient Data Synthesis
by: Li, Hanyu, et al.
Published: (2026)

Diffusion Models for Wireless Communications
by: Letafati, Mehdi, et al.
Published: (2023)

Why Self-Supervised Encoders Want to Be Normal
by: Domb, Yuval
Published: (2026)

WDMoE: Wireless Distributed Mixture of Experts for Large Language Models
by: Xue, Nan, et al.
Published: (2024)

A Simple Model of Inference Scaling Laws
by: Levi, Noam
Published: (2024)

A Wireless Foundation Model for Multi-Task Prediction
by: Sheng, Yucheng, et al.
Published: (2025)

Geometric Signatures of Compositionality Across a Language Model's Lifetime
by: Lee, Jin Hwa, et al.
Published: (2024)

Incentive-Aware Multi-Fidelity Optimization for Generative Advertising in Large Language Models
by: Liu, Jiayuan, et al.
Published: (2026)

MARS: Margin and Semantic-Aware Data Augmentation for Reward Modeling
by: Bhattacharjee, Payel, et al.
Published: (2026)

Neural Estimation of Pairwise Mutual Information in Masked Discrete Sequence Models
by: Sharma, Jai, et al.
Published: (2026)

Multi-head Transformers Provably Learn Symbolic Multi-step Reasoning via Gradient Descent
by: Yang, Tong, et al.
Published: (2025)

In-Context Learning for MIMO Equalization Using Transformer-Based Sequence Models
by: Zecchin, Matteo, et al.
Published: (2023)

IBB Traffic Graph Data: Benchmarking and Road Traffic Prediction Model
by: Olug, Eren, et al.
Published: (2024)

LLMs as Noisy Channels: A Shannon Perspective on Model Capacity and Scaling Laws
by: Ouyang, Xu, et al.
Published: (2026)

Conditional Denoising Diffusion Probabilistic Models for Data Reconstruction Enhancement in Wireless Communications
by: Letafati, Mehdi, et al.
Published: (2023)

Learning Unknown Intervention Targets in Structural Causal Models from Heterogeneous Data
by: Yang, Yuqin, et al.
Published: (2023)

ToDMA: Large Model-Driven Token-Domain Multiple Access for Semantic Communications
by: Qiao, Li, et al.
Published: (2025)