The Training Process of Many Deep Networks Explores the Same Low-Dimensional Manifold
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | Mao, Jialin, Griniasty, Itay, Teoh, Han Kheng, Ramesh, Rahul, Yang, Rubing, Transtrum, Mark K., Sethna, James P., Chaudhari, Pratik |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
An Analytical Characterization of Sloppiness in Neural Networks: Insights from Linear Models
par: Mao, Jialin, et autres
Publié: (2025)
par: Mao, Jialin, et autres
Publié: (2025)
How does Chain of Thought decompose complex tasks?
par: Nadgir, Amrut, et autres
Publié: (2026)
par: Nadgir, Amrut, et autres
Publié: (2026)
Phonon Echo from Multi-Level Systems and Many-Body Interactions in Low-Temperature Glasses
par: Zhou, Di
Publié: (2026)
par: Zhou, Di
Publié: (2026)
Scattering Expansion for Localization in One Dimension: from Disordered Wires to Quantum Walks
par: Culver, Adrian B., et autres
Publié: (2022)
par: Culver, Adrian B., et autres
Publié: (2022)
Scattering Expansion for Localization in One Dimension
par: Culver, Adrian B., et autres
Publié: (2022)
par: Culver, Adrian B., et autres
Publié: (2022)
Facets of Many Body Localization
par: Pawlik, Konrad, et autres
Publié: (2026)
par: Pawlik, Konrad, et autres
Publié: (2026)
Demystifying Spectral Bias on Real-World Data
par: Lavie, Itay, et autres
Publié: (2024)
par: Lavie, Itay, et autres
Publié: (2024)
Autoregressive model path dependence near Ising criticality
par: Teoh, Yi Hong, et autres
Publié: (2024)
par: Teoh, Yi Hong, et autres
Publié: (2024)
Many-body localization on finite generation fractal lattices
par: Manna, Sourav, et autres
Publié: (2021)
par: Manna, Sourav, et autres
Publié: (2021)
Memorization and Generalization in Generative Diffusion under the Manifold Hypothesis
par: Achilli, Beatrice, et autres
Publié: (2025)
par: Achilli, Beatrice, et autres
Publié: (2025)
Spread Complexity in Non-Hermitian Many-Body Localization Transition
par: Ganguli, Maitri
Publié: (2024)
par: Ganguli, Maitri
Publié: (2024)
The Capacity of Modern Hopfield Networks under the Data Manifold Hypothesis
par: Achilli, Beatrice, et autres
Publié: (2025)
par: Achilli, Beatrice, et autres
Publié: (2025)
Anderson Localization on Husimi Trees and its implications for Many-Body localization
par: Bandeira, Dafne Prado, et autres
Publié: (2026)
par: Bandeira, Dafne Prado, et autres
Publié: (2026)
Charge Transport Capacity as a Probe of Resonances in Models of Many-Body Localization
par: Jiang, Jessica Kaijia, et autres
Publié: (2026)
par: Jiang, Jessica Kaijia, et autres
Publié: (2026)
Towards Understanding Inductive Bias in Transformers: A View From Infinity
par: Lavie, Itay, et autres
Publié: (2024)
par: Lavie, Itay, et autres
Publié: (2024)
Many-body localization properties of one-dimensional anisotropic spin-1/2 chains
par: Hu, Taotao, et autres
Publié: (2025)
par: Hu, Taotao, et autres
Publié: (2025)
Training Dynamics of Nonlinear Contrastive Learning Model in the High Dimensional Limit
par: Meng, Lineghuan, et autres
Publié: (2024)
par: Meng, Lineghuan, et autres
Publié: (2024)
Many-body mobility edges in one dimension revealed by efficient and interpretable feature-based learning with Kolmogorov-Arnold Networks
par: Dai, Siqi, et autres
Publié: (2026)
par: Dai, Siqi, et autres
Publié: (2026)
Mobility Crossover in Two-Dimensional Berry Crystals
par: Chai, Zixuan, et autres
Publié: (2024)
par: Chai, Zixuan, et autres
Publié: (2024)
A High Dimensional Statistical Model for Adversarial Training: Geometry and Trade-Offs
par: Tanner, Kasimir, et autres
Publié: (2024)
par: Tanner, Kasimir, et autres
Publié: (2024)
Deep Learning-Based Quantum Transport Simulations in Two-Dimensional Materials
par: Zou, Jijie, et autres
Publié: (2025)
par: Zou, Jijie, et autres
Publié: (2025)
Topological mechanical neural networks as classifiers through in situ backpropagation learning
par: Li, Shuaifeng, et autres
Publié: (2025)
par: Li, Shuaifeng, et autres
Publié: (2025)
Delocalization Induced by Enhanced Hyperuniformity in One-Dimensional Disordered Systems
par: Jeon, Junmo, et autres
Publié: (2025)
par: Jeon, Junmo, et autres
Publié: (2025)
Ergodicity Breaking and High-Dimensional Chaos in Random Recurrent Networks
par: Martorell, Carles, et autres
Publié: (2025)
par: Martorell, Carles, et autres
Publié: (2025)
Exploring Unique Characteristics in Stark Many-Body Localization
par: Ching, Chung Po
Publié: (2025)
par: Ching, Chung Po
Publié: (2025)
Many-body dynamical localization in Fock space
par: Dupont, Nathan, et autres
Publié: (2026)
par: Dupont, Nathan, et autres
Publié: (2026)
Linear Readout of Neural Manifolds with Continuous Variables
par: Slatton, Will, et autres
Publié: (2026)
par: Slatton, Will, et autres
Publié: (2026)
Berezinskii-Kosterlitz-Thouless Transition and Multifractal Critical Phase in Two-Dimensional Quantum Percolation
par: Oliveira, W. S., et autres
Publié: (2025)
par: Oliveira, W. S., et autres
Publié: (2025)
Information in Many-body Eigenstates: A Question of Learnability
par: Kliczkowski, Maksymilian, et autres
Publié: (2026)
par: Kliczkowski, Maksymilian, et autres
Publié: (2026)
Many-body delocalization from embedded thermal inclusion
par: Peacock, J. Clayton, et autres
Publié: (2023)
par: Peacock, J. Clayton, et autres
Publié: (2023)
Stark Many-Body Localisation Under Periodic Driving
par: Duffin, Christian, et autres
Publié: (2024)
par: Duffin, Christian, et autres
Publié: (2024)
On Marginal Stability in Low Temperature Spherical Spin Glasses
par: Sellke, Mark
Publié: (2024)
par: Sellke, Mark
Publié: (2024)
Exponentially Slow Mixing of the Low Temperature SK Model
par: Sellke, Mark
Publié: (2025)
par: Sellke, Mark
Publié: (2025)
Exploring Metallic-Insulating Transition and Thermodynamic Applications of Fibonacci Quasicrystals
par: Xu, He-Guang, et autres
Publié: (2024)
par: Xu, He-Guang, et autres
Publié: (2024)
Machine Learning of Topological Insulator and Anderson Insulator in One-Dimensional Extended Su-Schrieffer-Heeger Chain
par: Yin, Zhekai, et autres
Publié: (2026)
par: Yin, Zhekai, et autres
Publié: (2026)
Tensor Cross Interpolation of Purities in Quantum Many-Body Systems
par: Kolisnyk, Dmytro, et autres
Publié: (2025)
par: Kolisnyk, Dmytro, et autres
Publié: (2025)
Many-body Localization Transition of Ising Spin-1 Chains
par: Hu, Taotao, et autres
Publié: (2024)
par: Hu, Taotao, et autres
Publié: (2024)
How to Train an Oscillator Ising Machine using Equilibrium Propagation
par: Gower, Alex
Publié: (2025)
par: Gower, Alex
Publié: (2025)
Grokking vs. Learning: Same Features, Different Encodings
par: Manning-Coe, Dmitry, et autres
Publié: (2025)
par: Manning-Coe, Dmitry, et autres
Publié: (2025)
Anomalous Random Neural Networks: a Special Renewal Process
par: Zhang, Hong, et autres
Publié: (2024)
par: Zhang, Hong, et autres
Publié: (2024)
Documents similaires
-
An Analytical Characterization of Sloppiness in Neural Networks: Insights from Linear Models
par: Mao, Jialin, et autres
Publié: (2025) -
How does Chain of Thought decompose complex tasks?
par: Nadgir, Amrut, et autres
Publié: (2026) -
Phonon Echo from Multi-Level Systems and Many-Body Interactions in Low-Temperature Glasses
par: Zhou, Di
Publié: (2026) -
Scattering Expansion for Localization in One Dimension: from Disordered Wires to Quantum Walks
par: Culver, Adrian B., et autres
Publié: (2022) -
Scattering Expansion for Localization in One Dimension
par: Culver, Adrian B., et autres
Publié: (2022)