Cover Image

Bottleneck Structure in Learned Features: Low-Dimension vs Regularity Tradeoff

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Jacot, Arthur
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Hamiltonian Mechanics of Feature Learning: Bottleneck Structure in Leaky ResNets
by: Jacot, Arthur, et al.
Published: (2024)

Which Frequencies do CNNs Need? Emergent Bottleneck Structure in Feature Learning
by: Wen, Yuxiao, et al.
Published: (2024)

Memory-Statistics Tradeoff in Continual Learning with Structural Regularization
by: Li, Haoran, et al.
Published: (2025)

Saddle-To-Saddle Dynamics in Deep ReLU Networks: Low-Rank Bias in the First Saddle Escape
by: Bantzis, Ioannis, et al.
Published: (2025)

How DNNs break the Curse of Dimensionality: Compositionality and Symmetry Learning
by: Jacot, Arthur, et al.
Published: (2024)

Mixed Dynamics In Linear Networks: Unifying the Lazy and Active Regimes
by: Tu, Zhenfeng, et al.
Published: (2024)

Graph Structure Learning with Temporal Graph Information Bottleneck for Inductive Representation Learning
by: Xiong, Jiafeng, et al.
Published: (2025)

Learning to Intervene on Concept Bottlenecks
by: Steinmann, David, et al.
Published: (2023)

These Are Not All the Features You Are Looking For: A Fundamental Bottleneck in Supervised Pretraining
by: Yang, Xingyu Alice, et al.
Published: (2025)

GaGSL: Global-augmented Graph Structure Learning via Graph Information Bottleneck
by: Li, Shuangjie, et al.
Published: (2024)

Credal Concept Bottleneck Models: Structural Separation of Epistemic and Aleatoric Uncertainty
by: Mukherjee, Tanmoy, et al.
Published: (2026)

On Tradeoffs in Learning-Augmented Algorithms
by: Benomar, Ziyad, et al.
Published: (2025)

Learning Concept Bottleneck Models from Mechanistic Explanations
by: De Santis, Antonio, et al.
Published: (2026)

IBNorm: Information-Bottleneck Inspired Normalization for Representation Learning
by: Zou, Xiandong, et al.
Published: (2025)

Is Value Learning Really the Main Bottleneck in Offline RL?
by: Park, Seohong, et al.
Published: (2024)

OPUS-VFL: Incentivizing Optimal Privacy-Utility Tradeoffs in Vertical Federated Learning
by: Madabushi, Sindhuja, et al.
Published: (2025)

Learning Regularizers: Learning Optimizers that can Regularize
by: Sahoo, Suraj Kumar, et al.
Published: (2025)

Prediction Bottlenecks Don't Discover Causal Structure (But Here's What They Actually Do)
by: Lade, Ankit Hemant, et al.
Published: (2026)

TimeX++: Learning Time-Series Explanations with Information Bottleneck
by: Liu, Zichuan, et al.
Published: (2024)

Learning Fair Graph Representations with Multi-view Information Bottleneck
by: Liu, Chuxun, et al.
Published: (2025)

Quantifying Empirical Compute-Supervision Tradeoffs in RLVR
by: Mitsuhashi, Ryo, et al.
Published: (2026)

Online Learning with Multiple Fairness Regularizers via Graph-Structured Feedback
by: Zhou, Quan, et al.
Published: (2025)

Reward Learning from Best-of-$N$ Preference Data: Targets, Tradeoffs, and Design Principles
by: Pukdee, Rattana, et al.
Published: (2026)

Tradeoffs When Considering Deep Reinforcement Learning for Contingency Management in Advanced Air Mobility
by: Alvarez, Luis E., et al.
Published: (2024)

Deep Learning as a Convex Paradigm of Computation: Minimizing Circuit Size with ResNets
by: Jacot, Arthur
Published: (2025)

Invariant Graph Learning Meets Information Bottleneck for Out-of-Distribution Generalization
by: Mao, Wenyu, et al.
Published: (2024)

Breaking the Safety-Capability Tradeoff: Reinforcement Learning with Verifiable Rewards Maintains Safety Guardrails in LLMs
by: Cho, Dongkyu Derek, et al.
Published: (2025)

Dynamic Graph Information Bottleneck
by: Yuan, Haonan, et al.
Published: (2024)

Counterfactual Concept Bottleneck Models
by: Dominici, Gabriele, et al.
Published: (2024)

Object Centric Concept Bottlenecks
by: Steinmann, David, et al.
Published: (2025)

Mixture of Concept Bottleneck Experts
by: De Santis, Francesco, et al.
Published: (2026)

Modeling Multi-Objective Tradeoffs with Monotonic Utility Functions
by: Chen, Edward, et al.
Published: (2024)

Stable-LoRA: Stabilizing Feature Learning of Low-Rank Adaptation
by: Wu, Yize, et al.
Published: (2026)

Policy Learning with a Language Bottleneck
by: Srivastava, Megha, et al.
Published: (2024)

LLM-Guided Reinforcement Learning: Addressing Training Bottlenecks through Policy Modulation
by: Tan, Heng, et al.
Published: (2025)

Breaking the Exploration Bottleneck: Rubric-Scaffolded Reinforcement Learning for General LLM Reasoning
by: Zhou, Yang, et al.
Published: (2025)

Contrastive Graph Representation Learning with Adversarial Cross-view Reconstruction and Information Bottleneck
by: Shou, Yuntao, et al.
Published: (2024)

Exploring the Privacy-Energy Consumption Tradeoff for Split Federated Learning
by: Lee, Joohyung, et al.
Published: (2023)

Data Difficulty and the Generalization--Extrapolation Tradeoff in LLM Fine-Tuning
by: Liu, Siyuan, et al.
Published: (2026)

FIRE: Frobenius-Isometry Reinitialization for Balancing the Stability-Plasticity Tradeoff
by: Han, Isaac, et al.
Published: (2026)