Imagen de Portada

The Implicit Bias of Heterogeneity towards Invariance: A Study of Multi-Environment Matrix Sensing

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Xu, Yang, Gu, Yihong, Fang, Cong
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Optimization and Control
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Implicit Bias and Convergence of Matrix Stochastic Mirror Descent
por: Akhtiamov, Danil, et al.
Publicado: (2026)

Implicit Bias in Matrix Factorization and its Explicit Realization in a New Architecture
por: Hou, Yikun, et al.
Publicado: (2025)

Implicit Regularization Makes Overparameterized Asymmetric Matrix Sensing Robust to Perturbations
por: Wind, Johan S.
Publicado: (2023)

The Power of Preconditioning in Overparameterized Low-Rank Matrix Sensing
por: Xu, Xingyu, et al.
Publicado: (2023)

Implicit Bias of Mirror Flow on Separable Data
por: Pesme, Scott, et al.
Publicado: (2024)

The Rich and the Simple: On the Implicit Bias of Adam and SGD
por: Vasudeva, Bhavya, et al.
Publicado: (2025)

Implicit Bias and Fast Convergence Rates for Self-attention
por: Vasudeva, Bhavya, et al.
Publicado: (2024)

Implicit Bias of Gradient Descent for Non-Homogeneous Deep Networks
por: Cai, Yuhang, et al.
Publicado: (2025)

Implicit Bias of Spectral Descent and Muon on Multiclass Separable Data
por: Fan, Chen, et al.
Publicado: (2025)

Convergence and Implicit Bias of Gradient Descent on Continual Linear Classification
por: Jung, Hyunji, et al.
Publicado: (2025)

Implicit Bias of AdamW: $\ell_\infty$ Norm Constrained Optimization
por: Xie, Shuo, et al.
Publicado: (2024)

Towards The Implicit Bias on Multiclass Separable Data Under Norm Constraints
por: Xie, Shengping, et al.
Publicado: (2026)

Implicit Regularization in Perturbed Deep Matrix Factorization: Spectral Conditions and Stability
por: Wang, Jingzhe, et al.
Publicado: (2026)

On the Implicit Bias of Adam
por: Cattaneo, Matias D., et al.
Publicado: (2023)

Near-optimal and Efficient First-Order Algorithm for Multi-Task Learning with Shared Linear Representation
por: Ding, Shihong, et al.
Publicado: (2026)

How Does the ReLU Activation Affect the Implicit Bias of Gradient Descent on High-dimensional Neural Network Regression?
por: Lai, Kuo-Wei, et al.
Publicado: (2026)

The Geometry of Projection Heads: Conditioning, Invariance, and Collapse
por: Chaudhry, Faris
Publicado: (2026)

Forward Invariance in Neural Network Controlled Systems
por: Harapanahalli, Akash, et al.
Publicado: (2023)

Efficient Over-parameterized Matrix Sensing from Noisy Measurements via Alternating Preconditioned Gradient Descent
por: Liu, Zhiyu, et al.
Publicado: (2025)

The Effect of Mini-Batch Noise on the Implicit Bias of Adam
por: Cattaneo, Matias D., et al.
Publicado: (2026)

Accelerating Single-Pass SGD for Generalized Linear Prediction
por: Chen, Qian, et al.
Publicado: (2026)

On the Benefits of Weight Normalization for Overparameterized Matrix Sensing
por: Wei, Yudong, et al.
Publicado: (2025)

Mitigating Gradient Bias in Multi-objective Learning: A Provably Convergent Stochastic Approach
por: Fernando, Heshan, et al.
Publicado: (2022)

A Mechanism Study of Delayed Loss Spikes in Batch-Normalized Linear Models
por: Gao, Peifeng, et al.
Publicado: (2026)

Implicit Bias of Per-sample Adam on Separable Data: Departure from the Full-batch Regime
por: Baek, Beomhan, et al.
Publicado: (2025)

The Optimality of (Accelerated) SGD for High-Dimensional Quadratic Optimization
por: Zhang, Haihan, et al.
Publicado: (2024)

Matrix Completion with Graph Information: A Provable Nonconvex Optimization Approach
por: Wang, Yao, et al.
Publicado: (2025)

Understanding SGD with Exponential Moving Average: A Case Study in Linear Regression
por: Li, Xuheng, et al.
Publicado: (2025)

Fast and Effective Computation of Generalized Symmetric Matrix Factorization
por: Yang, Lei, et al.
Publicado: (2026)

Convergence of Implicit Gradient Descent for Training Two-Layer Physics-Informed Neural Networks
por: Xu, Xianliang, et al.
Publicado: (2024)

Improving Generalization and Convergence by Enhancing Implicit Regularization
por: Wang, Mingze, et al.
Publicado: (2024)

Robust Implicit Regularization via Weight Normalization
por: Chou, Hung-Hsu, et al.
Publicado: (2023)

Subspace Optimization for Efficient Federated Learning under Heterogeneous Data
por: Zhu, Shuchen, et al.
Publicado: (2026)

Global Convergence of Four-Layer Matrix Factorization under Random Initialization
por: Luo, Minrui, et al.
Publicado: (2025)

Nonsmooth Implicit Differentiation: Deterministic and Stochastic Convergence Rates
por: Grazzi, Riccardo, et al.
Publicado: (2024)

Zeroth-Order Stochastic Mirror Descent Algorithms for Minimax Excess Risk Optimization
por: Gu, Zhihao, et al.
Publicado: (2024)

Implicit Riemannian Optimism with Applications to Min-Max Problems
por: Roux, Christophe, et al.
Publicado: (2025)

Implicit Differentiation for Hyperparameter Tuning the Weighted Graphical Lasso
por: Pouliquen, Can, et al.
Publicado: (2023)

End-to-End Training of High-Dimensional Optimal Control with Implicit Hamiltonians via Jacobian-Free Backpropagation
por: Gelphman, Eric, et al.
Publicado: (2025)

Provable Acceleration of Nesterov's Accelerated Gradient for Rectangular Matrix Factorization and Linear Neural Networks
por: Xu, Zhenghao, et al.
Publicado: (2024)