Imagen de Portada

Spurious Correlations in High Dimensional Regression: The Roles of Regularization, Simplicity Bias and Over-Parameterization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Bombari, Simone, Mondelli, Marco
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

How Spurious Features Are Memorized: Precise Analysis for Random and NTK Features
por: Bombari, Simone, et al.
Publicado: (2023)

High-Dimensional Private Linear Regression with Optimal Rates
por: Bombari, Simone, et al.
Publicado: (2025)

Privacy for Free in the Overparameterized Regime
por: Bombari, Simone, et al.
Publicado: (2024)

Towards Understanding the Word Sensitivity of Attention Layers: A Study via Random Features
por: Bombari, Simone, et al.
Publicado: (2024)

A Law of Data Reconstruction for Random Features (and Beyond)
por: Iurada, Leonardo, et al.
Publicado: (2025)

Identifying Spurious Biases Early in Training through the Lens of Simplicity Bias
por: Yang, Yu, et al.
Publicado: (2023)

Optimal Regularization for Performative Learning
por: Cyffers, Edwige, et al.
Publicado: (2025)

Optimal Representation Size: High-Dimensional Analysis of Pretraining and Linear Probing
por: Njaradi, Valentina, et al.
Publicado: (2026)

Neural Collapse versus Low-rank Bias: Is Deep Neural Collapse Really Optimal?
por: Súkeník, Peter, et al.
Publicado: (2024)

Spurious Correlation-Aware Embedding Regularization for Worst-Group Robustness
por: Park, Subeen, et al.
Publicado: (2025)

Neural Collapse is Globally Optimal in Deep Regularized ResNets and Transformers
por: Súkeník, Peter, et al.
Publicado: (2025)

Improved Scaling Laws via Weak-to-Strong Generalization in Random Feature Ridge Regression
por: Wu, Diyuan, et al.
Publicado: (2026)

Neural Collapse Beyond the Unconstrained Features Model: Landscape, Dynamics, and Generalization in the Mean-Field Regime
por: Wu, Diyuan, et al.
Publicado: (2025)

Random-Matrix-Induced Simplicity Bias in Over-parameterized Variational Quantum Circuits
por: Qi, Jun, et al.
Publicado: (2026)

A Compression Perspective on Simplicity Bias
por: Marty, Tom, et al.
Publicado: (2026)

Reassessing the Validity of Spurious Correlations Benchmarks
por: Bell, Samuel J., et al.
Publicado: (2024)

High-dimensional Analysis of Synthetic Data Selection
por: Rezaei, Parham, et al.
Publicado: (2025)

Criteria and Bias of Parameterized Linear Regression under Edge of Stability Regime
por: Zhang, Peiyuan, et al.
Publicado: (2024)

Out of Spuriousity: Improving Robustness to Spurious Correlations without Group Annotations
por: Le, Phuong Quynh, et al.
Publicado: (2024)

A Unified Stability Analysis of SAM vs SGD: Role of Data Coherence and Emergence of Simplicity Bias
por: Chang, Wei-Kai, et al.
Publicado: (2025)

Training on Plausible Counterfactuals Removes Spurious Correlations
por: Sadiku, Shpresim, et al.
Publicado: (2025)

Hierarchical Simplicity Bias of Neural Networks
por: Du, Zhehang
Publicado: (2023)

When Bias Pretends to Be Truth: How Spurious Correlations Undermine Hallucination Detection in LLMs
por: Wang, Shaowen, et al.
Publicado: (2025)

To Use or not to Use Muon: How Simplicity Bias in Optimizers Matters
por: Dragutinović, Sara, et al.
Publicado: (2026)

Severing Spurious Correlations with Data Pruning
por: Mulchandani, Varun, et al.
Publicado: (2025)

In-context Learning in Presence of Spurious Correlations
por: Harutyunyan, Hrayr, et al.
Publicado: (2024)

Revisiting Spurious Correlation in Domain Generalization
por: Qin, Bin, et al.
Publicado: (2024)

Shortcut to Nowhere: Demystifying Deep Spurious Regression
por: Xu, Guanrong, et al.
Publicado: (2026)

DP-KAN: Differentially Private Kolmogorov-Arnold Networks
por: Kalinin, Nikita P., et al.
Publicado: (2024)

Mitigating Spurious Correlations in Patch-wise Tumor Classification on High-Resolution Multimodal Images
por: Asaad, Ihab, et al.
Publicado: (2025)

Simplicity Bias via Global Convergence of Sharpness Minimization
por: Gatmiry, Khashayar, et al.
Publicado: (2024)

NeuronTune: Towards Self-Guided Spurious Bias Mitigation
por: Zheng, Guangtao, et al.
Publicado: (2025)

Matrix Denoising with Doubly Heteroscedastic Noise: Fundamental Limits and Optimal Spectral Methods
por: Zhang, Yihan, et al.
Publicado: (2024)

Elastic Representation: Mitigating Spurious Correlations for Group Robustness
por: Wen, Tao, et al.
Publicado: (2025)

Investigating the Robustness of Subtask Distillation under Spurious Correlation
por: Chormai, Pattarawat, et al.
Publicado: (2026)

Gradient Descent Finds Over-Parameterized Neural Networks with Sharp Generalization for Nonparametric Regression
por: Yang, Yingzhen, et al.
Publicado: (2024)

A Theory of How Pretraining Shapes Inductive Bias in Fine-Tuning
por: Anguita, Nicolas, et al.
Publicado: (2026)

Mitigating Spurious Correlations via Disagreement Probability
por: Han, Hyeonggeun, et al.
Publicado: (2024)

Improving Group Robustness on Spurious Correlation via Evidential Alignment
por: Ye, Wenqian, et al.
Publicado: (2025)

Does Weak-to-strong Generalization Happen under Spurious Correlations?
por: Liu, Chenruo, et al.
Publicado: (2025)