Cover Image

Coupled Entropy: A Goldilocks Generalization for Complex Systems

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Nelson, Kenric P.
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Statistical Mechanics Information Theory
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The unique, universal entropy for complex systems
by: Nelson, Kenric P.
Published: (2026)

Neural Entropy
by: Premkumar, Akhil
Published: (2024)

Information-Geometric Decomposition of Generalization Error in Unsupervised Learning
by: Kim, Gilhan
Published: (2026)

Quantum Neural Estimation of Entropies
by: Goldfeld, Ziv, et al.
Published: (2023)

Entropy, concentration, and learning: a statistical mechanics primer
by: Balsubramani, Akshay
Published: (2024)

On the uniqueness of the coupled entropy
by: Nelson, Kenric P.
Published: (2025)

A new pathway to generative artificial intelligence by minimizing the maximum entropy
by: Miotto, Mattia, et al.
Published: (2025)

Open Problems within Nonextensive Statistical Mechanics
by: Nelson, Kenric P.
Published: (2023)

The Thermodynamic Costs of Simple Linear Regression
by: D'Ambrosia, Samuel H., et al.
Published: (2026)

Entropy of Soft Random Geometric Graphs in General Geometries
by: Baker, Oliver, et al.
Published: (2026)

Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Losses
by: Abdelaleem, Eslam, et al.
Published: (2023)

Nonlinear statistical coupling
by: Nelson, Kenric P., et al.
Published: (2009)

Compression, Regularity, Randomness and Emergent Structure: Rethinking Physical Complexity in the Data-Driven Era
by: Dehghani, Nima
Published: (2025)

Entropy production in communication channels
by: Tasnim, Farita, et al.
Published: (2023)

Breaking the Finite-Sample Barrier in Entropy Coupling
by: Asoodeh, Shahab, et al.
Published: (2026)

Data efficiency, dimensionality reduction, and the generalized symmetric information bottleneck
by: Martini, K. Michael, et al.
Published: (2023)

On the Separability of Information in Diffusion Models
by: Premkumar, Akhil
Published: (2025)

Demonstration of Robust and Efficient Quantum Property Learning with Shallow Shadows
by: Hu, Hong-Ye, et al.
Published: (2024)

A $q$-Caputo Fractional Generalization of Tsallis Entropy: Series Representation and Non-Negativity Domains
by: Gonzalez, Matias P., et al.
Published: (2026)

Susceptibilities and Patterning: A Primer on Linear Response in Bayesian Learning
by: Elliott, Chris, et al.
Published: (2026)

Statistics of Min-max Normalized Eigenvalues in Random Matrices
by: Nakada, Hyakka, et al.
Published: (2025)

Laws of thermodynamics for exponential families
by: Balsubramani, Akshay
Published: (2025)

Review and Prospect of Algebraic Research in Equivalent Framework between Statistical Mechanics and Machine Learning Theory
by: Watanabe, Sumio
Published: (2024)

Independent Approximates enable closed-form estimation of heavy-tailed distributions
by: Nelson, Kenric P.
Published: (2020)

Statistical mechanics of extensive-width Bayesian neural networks near interpolation
by: Barbier, Jean, et al.
Published: (2025)

Graphical model for factorization and completion of relatively high rank tensors by sparse sampling
by: Cavaliere, Angelo Giorgio, et al.
Published: (2025)

Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation
by: Barbier, Jean, et al.
Published: (2025)

Optimal generalisation and learning transition in extensive-width shallow neural networks near interpolation
by: Barbier, Jean, et al.
Published: (2025)

ML-PWS: Estimating the Mutual Information Between Experimental Time Series Using Neural Networks
by: Reinhardt, Manuel, et al.
Published: (2025)

Learning to erase quantum states: thermodynamic implications of quantum learning theory
by: Zhao, Haimeng, et al.
Published: (2025)

Information theory for dimensionality reduction in dynamical systems
by: Schmitt, Matthew S., et al.
Published: (2023)

Quantum natural gradient without monotonicity
by: Sasaki, Toi, et al.
Published: (2024)

Sharp feature-learning transitions and Bayes-optimal neural scaling laws in extensive-width networks
by: Nguyen, Minh-Toan, et al.
Published: (2026)

A renormalization-group inspired lattice-based framework for piecewise generalized linear models
by: Chang, Joshua C.
Published: (2026)

Generalized free energy and excess/housekeeping decomposition in nonequilibrium systems: from large deviations to thermodynamic speed limits
by: Kolchinsky, Artemy, et al.
Published: (2024)

Collaborative filtering based on nonnegative/binary matrix factorization
by: Terui, Yukino, et al.
Published: (2024)

Quantum Fisher information matrices from Rényi relative entropies
by: Wilde, Mark M.
Published: (2025)

Quantum Information Dimension and Geometric Entropy
by: Anza, Fabio, et al.
Published: (2021)

Sliding down the stairs: how correlated latent variables accelerate learning with neural networks
by: Bardone, Lorenzo, et al.
Published: (2024)

Pointwise Generalization in Deep Neural Networks
by: Li, Shaojie, et al.
Published: (2026)