Cover Image

Redundancy as a Structural Information Principle for Learning and Generalization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bi, Yuda, Zhu, Ying, Calhoun, Vince D
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Scaling Laws are Redundancy Laws
by: Bi, Yuda, et al.
Published: (2025)

Reservoir Subspace Injection for Online ICA under Top-n Whitening
by: Xiao, Wenjun, et al.
Published: (2026)

Spectral Coherence Index: A Model-Free Metric for Protein Structural Ensemble Quality Assessment
by: Bi, Yuda, et al.
Published: (2026)

A 1/R Law for Kurtosis Contrast in Balanced Mixtures
by: Bi, Yuda, et al.
Published: (2026)

Grokking as a Falsifiable Finite-Size Transition
by: Bi, Yuda, et al.
Published: (2026)

Learning Invariant Graph Representations Through Redundant Information
by: Halder, Barproda, et al.
Published: (2025)

Cross-Spectral Witness for Hidden Nonequilibrium Beyond the Scalar Ceiling
by: Bi, Yuda, et al.
Published: (2026)

Conditioning on a Volatility Proxy Compresses the Apparent Timescale of Collective Market Correlation
by: Bi, Yuda, et al.
Published: (2026)

Neural Networks Learn Generic Multi-Index Models Near Information-Theoretic Limit
by: Zhang, Bohan, et al.
Published: (2025)

Beyond Redundancy: Information-aware Unsupervised Multiplex Graph Structure Learning
by: Shen, Zhixiang, et al.
Published: (2024)

General Information Metrics for Improving AI Model Training Efficiency
by: Xu, Jianfeng, et al.
Published: (2025)

Generalization and Informativeness of Conformal Prediction
by: Zecchin, Matteo, et al.
Published: (2024)

The Critical Horizon: Inspection Design Principles for Multi-Stage Operations and Deep Reasoning
by: Emadi, Seyed Morteza
Published: (2026)

Fairness Overfitting in Machine Learning: An Information-Theoretic Perspective
by: Laakom, Firas, et al.
Published: (2025)

Information-Theoretic State Variable Selection for Reinforcement Learning
by: Westphal, Charles, et al.
Published: (2024)

Generalization and Informativeness of Weighted Conformal Risk Control Under Covariate Shift
by: Zecchin, Matteo, et al.
Published: (2025)

Learning Unknown Intervention Targets in Structural Causal Models from Heterogeneous Data
by: Yang, Yuqin, et al.
Published: (2023)

Laplace Sample Information: Data Informativeness Through a Bayesian Lens
by: Kaiser, Johannes, et al.
Published: (2025)

Generalization Bounds: Perspectives from Information Theory and PAC-Bayes
by: Hellström, Fredrik, et al.
Published: (2023)

Informationally Compressive Anonymization: Non-Degrading Sensitive Input Protection for Privacy-Preserving Supervised Machine Learning
by: Samuelson, Jeremy J
Published: (2026)

Continual Learning-Aided Super-Resolution Scheme for Channel Reconstruction and Generalization in OFDM Systems
by: Chen, Jianqiao, et al.
Published: (2025)

A General Deep Learning Framework for Wireless Resource Allocation under Discrete Constraints
by: Wang, Yikun, et al.
Published: (2026)

End-to-End Learning of Geometrical Shaping Maximizing Generalized Mutual Information
by: Gümüs, Kadir, et al.
Published: (2019)

Generative Model-Aided Continual Learning for CSI Feedback in FDD mMIMO-OFDM Systems
by: Liu, Guijun, et al.
Published: (2025)

Hierarchical Spatio-Temporal State-Space Modeling for fMRI Analysis
by: Wei, Yuxiang, et al.
Published: (2024)

Beyond the Loss Curve: Scaling Laws, Active Learning, and the Limits of Learning from Exact Posteriors
by: Khorasani, Arian, et al.
Published: (2026)

Flexible Variational Information Bottleneck: Achieving Diverse Compression with a Single Training
by: Kudo, Sota, et al.
Published: (2024)

Rethinking KV Cache Eviction via a Unified Information-Theoretic Objective
by: Yang, Jiaming, et al.
Published: (2026)

Disentangled Structural and Featural Representation for Task-Agnostic Graph Valuation
by: Falahati, Ali, et al.
Published: (2024)

Semi-supervised Batch Learning From Logged Data
by: Aminian, Gholamali, et al.
Published: (2022)

Interpretable Diffusion via Information Decomposition
by: Kong, Xianghao, et al.
Published: (2023)

Tele-LLMs: A Series of Specialized Large Language Models for Telecommunications
by: Maatouk, Ali, et al.
Published: (2024)

Machine Unlearning via Information Theoretic Regularization
by: Xu, Shizhou, et al.
Published: (2025)

Information-theoretic Bayesian Optimization: Survey and Tutorial
by: Garrido-Merchán, Eduardo C.
Published: (2025)

An Effective Information Theoretic Framework for Channel Pruning
by: Chen, Yihao, et al.
Published: (2024)

An Information-Theoretic Criterion for Efficient Data Synthesis
by: Li, Hanyu, et al.
Published: (2026)

An Information Criterion for Controlled Disentanglement of Multimodal Data
by: Wang, Chenyu, et al.
Published: (2024)

Enhancing Explainability of Graph Neural Networks Through Conceptual and Structural Analyses and Their Extensions
by: Bui, Tien Cuong
Published: (2025)

Partial Information Decomposition for Data Interpretability and Feature Selection
by: Westphal, Charles, et al.
Published: (2024)

A Rational Account of Categorization Based on Information Theory
by: MacLellan, Christopher J., et al.
Published: (2026)