Image de couverture de livre

Hamiltonian Mechanics of Feature Learning: Bottleneck Structure in Leaky ResNets

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Jacot, Arthur, Kaiser, Alexandre
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Bottleneck Structure in Learned Features: Low-Dimension vs Regularity Tradeoff
par: Jacot, Arthur
Publié: (2023)

Which Frequencies do CNNs Need? Emergent Bottleneck Structure in Feature Learning
par: Wen, Yuxiao, et autres
Publié: (2024)

Deep Learning as a Convex Paradigm of Computation: Minimizing Circuit Size with ResNets
par: Jacot, Arthur
Publié: (2025)

ResNets Are Deeper Than You Think
par: Mehmeti-Göpel, Christian H. X. Ali, et autres
Publié: (2025)

L-Lipschitz Gershgorin ResNet Network
par: Juston, Marius F. R., et autres
Publié: (2025)

On the inductive bias of infinite-depth ResNets and the bottleneck rank
par: Boix-Adsera, Enric
Publié: (2025)

Neural Collapse is Globally Optimal in Deep Regularized ResNets and Transformers
par: Súkeník, Peter, et autres
Publié: (2025)

Bridging Neural ODE and ResNet: A Formal Error Bound for Safety Verification
par: Sayed, Abdelrahman Sayed, et autres
Publié: (2025)

Cardioformer: Advancing AI in ECG Analysis with Multi-Granularity Patching and ResNet
par: Mobin, Md Kamrujjaman, et autres
Publié: (2025)

Acute Lymphoblastic Leukemia Diagnosis Employing YOLOv11, YOLOv8, ResNet50, and Inception-ResNet-v2 Deep Learning Models
par: Awad, Alaa, et autres
Publié: (2025)

Progressive Feedforward Collapse of ResNet Training
par: Wang, Sicong, et autres
Publié: (2024)

How DNNs break the Curse of Dimensionality: Compositionality and Symmetry Learning
par: Jacot, Arthur, et autres
Publié: (2024)

Mixed Dynamics In Linear Networks: Unifying the Lazy and Active Regimes
par: Tu, Zhenfeng, et autres
Publié: (2024)

Saddle-To-Saddle Dynamics in Deep ReLU Networks: Low-Rank Bias in the First Saddle Escape
par: Bantzis, Ioannis, et autres
Publié: (2025)

Lightweight Quantum-Enhanced ResNet for Coronary Angiography Classification: A Hybrid Quantum-Classical Feature Enhancement Framework
par: Xia, Jingsong
Publié: (2026)

AdaResNet: Enhancing Residual Networks with Dynamic Weight Adjustment for Improved Feature Integration
par: Su, Hong
Publié: (2024)

A Neural Architecture Search Method using Auxiliary Evaluation Metric based on ResNet Architecture
par: Wang, Shang, et autres
Publié: (2025)

PlantDiseaseNet-RT50: A Fine-tuned ResNet50 Architecture for High-Accuracy Plant Disease Detection Beyond Standard CNNs
par: Sagnika, Santwana, et autres
Publié: (2025)

Lung Cancer Classification from CT Images Using ResNet
par: Adekunle, Olajumoke O., et autres
Publié: (2025)

Graph Structure Learning with Temporal Graph Information Bottleneck for Inductive Representation Learning
par: Xiong, Jiafeng, et autres
Publié: (2025)

MFI-ResNet: Efficient ResNet Architecture Optimization via MeanFlow Compression and Selective Incubation
par: Sun, Nuolin, et autres
Publié: (2025)

Scaling ResNets in the Large-depth Regime
par: Marion, Pierre, et autres
Publié: (2022)

ResBM: Residual Bottleneck Models for Low-Bandwidth Pipeline Parallelism
par: Aboudib, Alan, et autres
Publié: (2026)

Learning to Intervene on Concept Bottlenecks
par: Steinmann, David, et autres
Publié: (2023)

These Are Not All the Features You Are Looking For: A Fundamental Bottleneck in Supervised Pretraining
par: Yang, Xingyu Alice, et autres
Publié: (2025)

GaGSL: Global-augmented Graph Structure Learning via Graph Information Bottleneck
par: Li, Shuangjie, et autres
Publié: (2024)

XFACTORS: Disentangled Information Bottleneck via Contrastive Supervision
par: Myara, Alexandre, et autres
Publié: (2026)

Transformative or Conservative? Conservation laws for ResNets and Transformers
par: Marcotte, Sibylle, et autres
Publié: (2025)

StormNet: Improving storm surge predictions with a GNN-based spatio-temporal offset forecasting model
par: Nader, Noujoud, et autres
Publié: (2026)

Credal Concept Bottleneck Models: Structural Separation of Epistemic and Aleatoric Uncertainty
par: Mukherjee, Tanmoy, et autres
Publié: (2026)

Universal approximation property of ODENet and ResNet with a single activation function
par: Kimura, Masato, et autres
Publié: (2024)

Is Value Learning Really the Main Bottleneck in Offline RL?
par: Park, Seohong, et autres
Publié: (2024)

Learning Concept Bottleneck Models from Mechanistic Explanations
par: De Santis, Antonio, et autres
Publié: (2026)

IBNorm: Information-Bottleneck Inspired Normalization for Representation Learning
par: Zou, Xiandong, et autres
Publié: (2025)

Interpreting the Residual Stream of ResNet18
par: Longon, André
Publié: (2024)

Approximation theory for 1-Lipschitz ResNets
par: Murari, Davide, et autres
Publié: (2025)

Three Mechanisms of Feature Learning in a Linear Network
par: Xu, Yizhou, et autres
Publié: (2024)

Generalization of Scaled Deep ResNets in the Mean-Field Regime
par: Chen, Yihang, et autres
Publié: (2024)

Prediction Bottlenecks Don't Discover Causal Structure (But Here's What They Actually Do)
par: Lade, Ankit Hemant, et autres
Publié: (2026)

Quotient Network -- A Network Similar to ResNet but Learning Quotients
par: Hui, Peng, et autres
Publié: (2025)