Copertina

Hamiltonian Mechanics of Feature Learning: Bottleneck Structure in Leaky ResNets

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Jacot, Arthur, Kaiser, Alexandre
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Bottleneck Structure in Learned Features: Low-Dimension vs Regularity Tradeoff
di: Jacot, Arthur
Pubblicazione: (2023)

Which Frequencies do CNNs Need? Emergent Bottleneck Structure in Feature Learning
di: Wen, Yuxiao, et al.
Pubblicazione: (2024)

Deep Learning as a Convex Paradigm of Computation: Minimizing Circuit Size with ResNets
di: Jacot, Arthur
Pubblicazione: (2025)

ResNets Are Deeper Than You Think
di: Mehmeti-Göpel, Christian H. X. Ali, et al.
Pubblicazione: (2025)

L-Lipschitz Gershgorin ResNet Network
di: Juston, Marius F. R., et al.
Pubblicazione: (2025)

On the inductive bias of infinite-depth ResNets and the bottleneck rank
di: Boix-Adsera, Enric
Pubblicazione: (2025)

Neural Collapse is Globally Optimal in Deep Regularized ResNets and Transformers
di: Súkeník, Peter, et al.
Pubblicazione: (2025)

Bridging Neural ODE and ResNet: A Formal Error Bound for Safety Verification
di: Sayed, Abdelrahman Sayed, et al.
Pubblicazione: (2025)

Cardioformer: Advancing AI in ECG Analysis with Multi-Granularity Patching and ResNet
di: Mobin, Md Kamrujjaman, et al.
Pubblicazione: (2025)

Acute Lymphoblastic Leukemia Diagnosis Employing YOLOv11, YOLOv8, ResNet50, and Inception-ResNet-v2 Deep Learning Models
di: Awad, Alaa, et al.
Pubblicazione: (2025)

Progressive Feedforward Collapse of ResNet Training
di: Wang, Sicong, et al.
Pubblicazione: (2024)

How DNNs break the Curse of Dimensionality: Compositionality and Symmetry Learning
di: Jacot, Arthur, et al.
Pubblicazione: (2024)

Mixed Dynamics In Linear Networks: Unifying the Lazy and Active Regimes
di: Tu, Zhenfeng, et al.
Pubblicazione: (2024)

Saddle-To-Saddle Dynamics in Deep ReLU Networks: Low-Rank Bias in the First Saddle Escape
di: Bantzis, Ioannis, et al.
Pubblicazione: (2025)

Lightweight Quantum-Enhanced ResNet for Coronary Angiography Classification: A Hybrid Quantum-Classical Feature Enhancement Framework
di: Xia, Jingsong
Pubblicazione: (2026)

AdaResNet: Enhancing Residual Networks with Dynamic Weight Adjustment for Improved Feature Integration
di: Su, Hong
Pubblicazione: (2024)

A Neural Architecture Search Method using Auxiliary Evaluation Metric based on ResNet Architecture
di: Wang, Shang, et al.
Pubblicazione: (2025)

PlantDiseaseNet-RT50: A Fine-tuned ResNet50 Architecture for High-Accuracy Plant Disease Detection Beyond Standard CNNs
di: Sagnika, Santwana, et al.
Pubblicazione: (2025)

Lung Cancer Classification from CT Images Using ResNet
di: Adekunle, Olajumoke O., et al.
Pubblicazione: (2025)

Graph Structure Learning with Temporal Graph Information Bottleneck for Inductive Representation Learning
di: Xiong, Jiafeng, et al.
Pubblicazione: (2025)

MFI-ResNet: Efficient ResNet Architecture Optimization via MeanFlow Compression and Selective Incubation
di: Sun, Nuolin, et al.
Pubblicazione: (2025)

Scaling ResNets in the Large-depth Regime
di: Marion, Pierre, et al.
Pubblicazione: (2022)

ResBM: Residual Bottleneck Models for Low-Bandwidth Pipeline Parallelism
di: Aboudib, Alan, et al.
Pubblicazione: (2026)

Learning to Intervene on Concept Bottlenecks
di: Steinmann, David, et al.
Pubblicazione: (2023)

These Are Not All the Features You Are Looking For: A Fundamental Bottleneck in Supervised Pretraining
di: Yang, Xingyu Alice, et al.
Pubblicazione: (2025)

GaGSL: Global-augmented Graph Structure Learning via Graph Information Bottleneck
di: Li, Shuangjie, et al.
Pubblicazione: (2024)

XFACTORS: Disentangled Information Bottleneck via Contrastive Supervision
di: Myara, Alexandre, et al.
Pubblicazione: (2026)

Transformative or Conservative? Conservation laws for ResNets and Transformers
di: Marcotte, Sibylle, et al.
Pubblicazione: (2025)

StormNet: Improving storm surge predictions with a GNN-based spatio-temporal offset forecasting model
di: Nader, Noujoud, et al.
Pubblicazione: (2026)

Credal Concept Bottleneck Models: Structural Separation of Epistemic and Aleatoric Uncertainty
di: Mukherjee, Tanmoy, et al.
Pubblicazione: (2026)

Universal approximation property of ODENet and ResNet with a single activation function
di: Kimura, Masato, et al.
Pubblicazione: (2024)

Is Value Learning Really the Main Bottleneck in Offline RL?
di: Park, Seohong, et al.
Pubblicazione: (2024)

Learning Concept Bottleneck Models from Mechanistic Explanations
di: De Santis, Antonio, et al.
Pubblicazione: (2026)

IBNorm: Information-Bottleneck Inspired Normalization for Representation Learning
di: Zou, Xiandong, et al.
Pubblicazione: (2025)

Interpreting the Residual Stream of ResNet18
di: Longon, André
Pubblicazione: (2024)

Approximation theory for 1-Lipschitz ResNets
di: Murari, Davide, et al.
Pubblicazione: (2025)

Three Mechanisms of Feature Learning in a Linear Network
di: Xu, Yizhou, et al.
Pubblicazione: (2024)

Generalization of Scaled Deep ResNets in the Mean-Field Regime
di: Chen, Yihang, et al.
Pubblicazione: (2024)

Prediction Bottlenecks Don't Discover Causal Structure (But Here's What They Actually Do)
di: Lade, Ankit Hemant, et al.
Pubblicazione: (2026)

Quotient Network -- A Network Similar to ResNet but Learning Quotients
di: Hui, Peng, et al.
Pubblicazione: (2025)