Cover Image

Neural Entropy

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Premkumar, Akhil
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Statistical Mechanics Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

On the Separability of Information in Diffusion Models
by: Premkumar, Akhil
Published: (2025)

Quantum Neural Estimation of Entropies
by: Goldfeld, Ziv, et al.
Published: (2023)

Coupled Entropy: A Goldilocks Generalization for Complex Systems
by: Nelson, Kenric P.
Published: (2025)

Entropy, concentration, and learning: a statistical mechanics primer
by: Balsubramani, Akshay
Published: (2024)

Information-Geometric Decomposition of Generalization Error in Unsupervised Learning
by: Kim, Gilhan
Published: (2026)

A new pathway to generative artificial intelligence by minimizing the maximum entropy
by: Miotto, Mattia, et al.
Published: (2025)

The Thermodynamic Costs of Simple Linear Regression
by: D'Ambrosia, Samuel H., et al.
Published: (2026)

Entropy production in communication channels
by: Tasnim, Farita, et al.
Published: (2023)

Data efficiency, dimensionality reduction, and the generalized symmetric information bottleneck
by: Martini, K. Michael, et al.
Published: (2023)

Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Losses
by: Abdelaleem, Eslam, et al.
Published: (2023)

Demonstration of Robust and Efficient Quantum Property Learning with Shallow Shadows
by: Hu, Hong-Ye, et al.
Published: (2024)

ML-PWS: Estimating the Mutual Information Between Experimental Time Series Using Neural Networks
by: Reinhardt, Manuel, et al.
Published: (2025)

The Diffusion Encoder
by: Premkumar, Akhil, et al.
Published: (2026)

Entropy of Soft Random Geometric Graphs in General Geometries
by: Baker, Oliver, et al.
Published: (2026)

Review and Prospect of Algebraic Research in Equivalent Framework between Statistical Mechanics and Machine Learning Theory
by: Watanabe, Sumio
Published: (2024)

Susceptibilities and Patterning: A Primer on Linear Response in Bayesian Learning
by: Elliott, Chris, et al.
Published: (2026)

Statistics of Min-max Normalized Eigenvalues in Random Matrices
by: Nakada, Hyakka, et al.
Published: (2025)

Laws of thermodynamics for exponential families
by: Balsubramani, Akshay
Published: (2025)

Compression, Regularity, Randomness and Emergent Structure: Rethinking Physical Complexity in the Data-Driven Era
by: Dehghani, Nima
Published: (2025)

Quantum natural gradient without monotonicity
by: Sasaki, Toi, et al.
Published: (2024)

Statistical mechanics of extensive-width Bayesian neural networks near interpolation
by: Barbier, Jean, et al.
Published: (2025)

Information theory for dimensionality reduction in dynamical systems
by: Schmitt, Matthew S., et al.
Published: (2023)

Sharp feature-learning transitions and Bayes-optimal neural scaling laws in extensive-width networks
by: Nguyen, Minh-Toan, et al.
Published: (2026)

Graphical model for factorization and completion of relatively high rank tensors by sparse sampling
by: Cavaliere, Angelo Giorgio, et al.
Published: (2025)

Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation
by: Barbier, Jean, et al.
Published: (2025)

Optimal generalisation and learning transition in extensive-width shallow neural networks near interpolation
by: Barbier, Jean, et al.
Published: (2025)

Learning to erase quantum states: thermodynamic implications of quantum learning theory
by: Zhao, Haimeng, et al.
Published: (2025)

Pointwise Generalization in Deep Neural Networks
by: Li, Shaojie, et al.
Published: (2026)

Collaborative filtering based on nonnegative/binary matrix factorization
by: Terui, Yukino, et al.
Published: (2024)

Quantum Fisher information matrices from Rényi relative entropies
by: Wilde, Mark M.
Published: (2025)

Sliding down the stairs: how correlated latent variables accelerate learning with neural networks
by: Bardone, Lorenzo, et al.
Published: (2024)

A renormalization-group inspired lattice-based framework for piecewise generalized linear models
by: Chang, Joshua C.
Published: (2026)

A $q$-Caputo Fractional Generalization of Tsallis Entropy: Series Representation and Non-Negativity Domains
by: Gonzalez, Matias P., et al.
Published: (2026)

Breaking the Finite-Sample Barrier in Entropy Coupling
by: Asoodeh, Shahab, et al.
Published: (2026)

Empirical Risk Minimization with Relative Entropy Regularization
by: Perlaza, Samir M., et al.
Published: (2022)

$α$-divergence Improves the Entropy Production Estimation via Machine Learning
by: Kwon, Euijoon, et al.
Published: (2023)

Mutual information and the encoding of contingency tables
by: Jerdee, Maximilian, et al.
Published: (2024)

Stretched and measured neural predictions of complex network dynamics
by: Vasiliauskaite, Vaiva, et al.
Published: (2023)

The monotonicity of the Franz-Parisi potential is equivalent with Low-degree MMSE lower bounds
by: Tsirkas, Konstantinos, et al.
Published: (2026)

An Optimized Franz-Parisi Criterion and its Equivalence with SQ Lower Bounds
by: Chen, Siyu, et al.
Published: (2025)