Cover Image

The Maximum von Neumann Entropy Principle: Theory and Applications in Machine Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wu, Youqi, Farnia, Farzan
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

On the Inductive Biases of Demographic Parity-based Fair Learning Algorithms
by: Lei, Haoyu, et al.
Published: (2024)

When Kernels Multiply, Clusters Unify: Fusing Embeddings with the Kronecker Product
by: Wu, Youqi, et al.
Published: (2025)

On the Fragility of AI-Based Channel Decoders under Small Channel Perturbations
by: Lei, Haoyu, et al.
Published: (2026)

The Principle of Uncertain Maximum Entropy
by: Bogert, Kenneth, et al.
Published: (2023)

Hierarchical Maximum Entropy via the Renormalization Group
by: Asadi, Amir R.
Published: (2025)

Conditional Vendi Score: An Information-Theoretic Approach to Diversity Evaluation of Prompt-based Generative Models
by: Jalali, Mohammad, et al.
Published: (2024)

A Theory of Machine Understanding via the Minimum Description Length Principle
by: Zhang, Canlin, et al.
Published: (2025)

Out-of-Distribution Detection using Maximum Entropy Coding
by: Abolfazli, Mojtaba, et al.
Published: (2024)

In-Context Learning for Gradient-Free Receiver Adaptation: Principles, Applications, and Theory
by: Zecchin, Matteo, et al.
Published: (2025)

Advancing Deep Active Learning & Data Subset Selection: Unifying Principles with Information-Theory Intuitions
by: Kirsch, Andreas
Published: (2024)

Machine Learning Predictors for Min-Entropy Estimation
by: Blanco-Romero, Javier, et al.
Published: (2024)

Bridging Algorithmic Information Theory and Machine Learning: A New Approach to Kernel Learning
by: Hamzi, Boumediene, et al.
Published: (2023)

Matrix Completion via Nonsmooth Regularization of Fully Connected Neural Networks
by: Faramarzi, Sajad, et al.
Published: (2024)

MESSY Estimation: Maximum-Entropy based Stochastic and Symbolic densitY Estimation
by: Tohme, Tony, et al.
Published: (2023)

DAK-UCB: Diversity-Aware Prompt Routing for LLMs and Generative Models
by: Jafari, Donya, et al.
Published: (2026)

An Interpretable Evaluation of Entropy-based Novelty of Generative Models
by: Zhang, Jingwei, et al.
Published: (2024)

Towards an Explainable Comparison and Alignment of Feature Embeddings
by: Jalali, Mohammad, et al.
Published: (2025)

Sensor Design for Accuracy-Bounded Estimation via Maximum-Entropy Likelihood Synthesis
by: Bhattacharya, Raktim
Published: (2026)

Do Vendi Scores Converge with Finite Samples? Truncated Vendi Score for Finite-Sample Convergence Guarantees
by: Ospanov, Azim, et al.
Published: (2024)

Certified Adversarial Robustness via Partition-based Randomized Smoothing
by: Goli, Hossein, et al.
Published: (2024)

Output-Constrained Lossy Source Coding With Application to Rate-Distortion-Perception Theory
by: Xie, Li, et al.
Published: (2024)

Minimum Entropy Coupling with Bottleneck
by: Ebrahimi, M. Reza, et al.
Published: (2024)

The Generalization Error of Supervised Machine Learning Algorithms
by: Perlaza, Samir M., et al.
Published: (2024)

Foundation of Calculating Normalized Maximum Likelihood for Continuous Probability Models
by: Suzuki, Atsushi, et al.
Published: (2024)

A Generalized Information Bottleneck Theory of Deep Learning
by: Westphal, Charles, et al.
Published: (2025)

On the Theory of Continual Learning with Gradient Descent for Neural Networks
by: Taheri, Hossein, et al.
Published: (2025)

A Link between Coding Theory and Cross-Validation with Applications
by: Pahikkala, Tapio, et al.
Published: (2021)

Theory of Minimal Weight Perturbations in Deep Networks and its Applications for Low-Rank Activated Backdoor Attacks
by: Evans, Bethan, et al.
Published: (2026)

Information-Theoretic Framework for Understanding Modern Machine-Learning
by: Feder, Meir, et al.
Published: (2025)

TREET: TRansfer Entropy Estimation via Transformers
by: Luxembourg, Omer, et al.
Published: (2024)

Transfer Entropy in Graph Convolutional Neural Networks
by: Moldovan, Adrian, et al.
Published: (2024)

Accelerating Relative Entropy Coding with Space Partitioning
by: He, Jiajun, et al.
Published: (2024)

Fundamental Properties of Causal Entropy and Information Gain
by: Simoes, Francisco N. F. Q., et al.
Published: (2024)

The Gap Between Principle and Practice of Lossy Image Coding
by: Zhang, Haotian, et al.
Published: (2025)

Application of Deep Learning in Biological Data Compression
by: Zou, Chunyu
Published: (2025)

Sparse Domain Transfer via Elastic Net Regularization
by: Zhang, Jingwei, et al.
Published: (2024)

Gaussian Smoothing in Saliency Maps: The Stability-Fidelity Trade-Off in Neural Network Interpretability
by: Ye, Zhuorui, et al.
Published: (2024)

Quantifying the Prediction Uncertainty of Machine Learning Models for Individual Data
by: Bibas, Koby
Published: (2024)

Redundancy as a Structural Information Principle for Learning and Generalization
by: Bi, Yuda, et al.
Published: (2025)

Dictionary Based Pattern Entropy for Causal Direction Discovery
by: B, Harikrishnan N, et al.
Published: (2026)