Cover Image

The Thermodynamic Costs of Simple Linear Regression

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	D'Ambrosia, Samuel H., Daniels, Sultan M., DeWeese, Michael R., Sahai, Anant
Format:	Preprint
Published:	2026
Subjects:	Statistical Mechanics Information Theory Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Entropy of Floating-Point Numbers
by: Daniels, Sultan, et al.
Published: (2026)

Higher-order response theory in optimal stochastic thermodynamics
by: DAmbrosia, Samuel. H., et al.
Published: (2025)

Beyond Linear Response: Equivalence between Thermodynamic Geometry and Optimal Transport
by: Zhong, Adrianne, et al.
Published: (2024)

Information-Geometric Decomposition of Generalization Error in Unsupervised Learning
by: Kim, Gilhan
Published: (2026)

Coupled Entropy: A Goldilocks Generalization for Complex Systems
by: Nelson, Kenric P.
Published: (2025)

A new pathway to generative artificial intelligence by minimizing the maximum entropy
by: Miotto, Mattia, et al.
Published: (2025)

Neural Entropy
by: Premkumar, Akhil
Published: (2024)

Data efficiency, dimensionality reduction, and the generalized symmetric information bottleneck
by: Martini, K. Michael, et al.
Published: (2023)

Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Losses
by: Abdelaleem, Eslam, et al.
Published: (2023)

Susceptibilities and Patterning: A Primer on Linear Response in Bayesian Learning
by: Elliott, Chris, et al.
Published: (2026)

Thermodynamic limit under Partial Observability
by: Sudo, Akihito
Published: (2021)

Max-Linear Regression by Convex Programming
by: Kim, Seonho, et al.
Published: (2021)

The Preservation Tradeoff: A Thermodynamic Bound in the Diminishing-Returns Regime
by: Brandes, Amadeus
Published: (2025)

Demonstration of Robust and Efficient Quantum Property Learning with Shallow Shadows
by: Hu, Hong-Ye, et al.
Published: (2024)

Quantum Neural Estimation of Entropies
by: Goldfeld, Ziv, et al.
Published: (2023)

Entropy, concentration, and learning: a statistical mechanics primer
by: Balsubramani, Akshay
Published: (2024)

On the Separability of Information in Diffusion Models
by: Premkumar, Akhil
Published: (2025)

Time-Asymmetric Fluctuation Theorem and Efficient Free Energy Estimation
by: Zhong, Adrianne, et al.
Published: (2023)

Batches Stabilize the Minimum Norm Risk in High Dimensional Overparameterized Linear Regression
by: Ioushua, Shahar Stein, et al.
Published: (2023)

Information theory for dimensionality reduction in dynamical systems
by: Schmitt, Matthew S., et al.
Published: (2023)

Thermodynamic Performance Limits for Score-Based Diffusion Models
by: Kodama, Nathan X., et al.
Published: (2025)

Spectral Efficiency Expression for the Non-Linear Schrödinger Channel in the Low Noise Limit Using Scattering Data
by: Kazakopoulos, Pavlos, et al.
Published: (2025)

Review and Prospect of Algebraic Research in Equivalent Framework between Statistical Mechanics and Machine Learning Theory
by: Watanabe, Sumio
Published: (2024)

Statistics of Min-max Normalized Eigenvalues in Random Matrices
by: Nakada, Hyakka, et al.
Published: (2025)

Laws of thermodynamics for exponential families
by: Balsubramani, Akshay
Published: (2025)

Compression, Regularity, Randomness and Emergent Structure: Rethinking Physical Complexity in the Data-Driven Era
by: Dehghani, Nima
Published: (2025)

Statistical mechanics of extensive-width Bayesian neural networks near interpolation
by: Barbier, Jean, et al.
Published: (2025)

Quantum natural gradient without monotonicity
by: Sasaki, Toi, et al.
Published: (2024)

Sharp feature-learning transitions and Bayes-optimal neural scaling laws in extensive-width networks
by: Nguyen, Minh-Toan, et al.
Published: (2026)

Graphical model for factorization and completion of relatively high rank tensors by sparse sampling
by: Cavaliere, Angelo Giorgio, et al.
Published: (2025)

Statistical physics of deep learning: Optimal learning of a multi-layer perceptron near interpolation
by: Barbier, Jean, et al.
Published: (2025)

Optimal generalisation and learning transition in extensive-width shallow neural networks near interpolation
by: Barbier, Jean, et al.
Published: (2025)

ML-PWS: Estimating the Mutual Information Between Experimental Time Series Using Neural Networks
by: Reinhardt, Manuel, et al.
Published: (2025)

Learning to erase quantum states: thermodynamic implications of quantum learning theory
by: Zhao, Haimeng, et al.
Published: (2025)

Scaling Autoregressive Models for Lattice Thermodynamics
by: Du, Xiaochen, et al.
Published: (2026)

Thermodynamic Bayesian Inference
by: Aifer, Maxwell, et al.
Published: (2024)

Shuffled Linear Regression via Spectral Matching
by: Liu, Hang, et al.
Published: (2024)

Collaborative filtering based on nonnegative/binary matrix factorization
by: Terui, Yukino, et al.
Published: (2024)

Entropy production in communication channels
by: Tasnim, Farita, et al.
Published: (2023)

Quantum Fisher information matrices from Rényi relative entropies
by: Wilde, Mark M.
Published: (2025)