Cover Image

How Spurious Features Are Memorized: Precise Analysis for Random and NTK Features

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bombari, Simone, Mondelli, Marco
Format:	Preprint
Published:	2023
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Towards Understanding the Word Sensitivity of Attention Layers: A Study via Random Features
by: Bombari, Simone, et al.
Published: (2024)

Spurious Correlations in High Dimensional Regression: The Roles of Regularization, Simplicity Bias and Over-Parameterization
by: Bombari, Simone, et al.
Published: (2025)

A Law of Data Reconstruction for Random Features (and Beyond)
by: Iurada, Leonardo, et al.
Published: (2025)

Privacy for Free in the Overparameterized Regime
by: Bombari, Simone, et al.
Published: (2024)

High-Dimensional Private Linear Regression with Optimal Rates
by: Bombari, Simone, et al.
Published: (2025)

Improved Scaling Laws via Weak-to-Strong Generalization in Random Feature Ridge Regression
by: Wu, Diyuan, et al.
Published: (2026)

Neural Collapse Beyond the Unconstrained Features Model: Landscape, Dynamics, and Generalization in the Mean-Field Regime
by: Wu, Diyuan, et al.
Published: (2025)

Feature Identification via the Empirical NTK
by: Lin, Jennifer
Published: (2025)

Richer Bayesian Last Layers with Subsampled NTK Features
by: Calvo-Ordoñez, Sergio, et al.
Published: (2026)

LoRA Training in the NTK Regime has No Spurious Local Minima
by: Jang, Uijeong, et al.
Published: (2024)

Spurious Rewards Paradox: Mechanistically Understanding How RLVR Activates Memorization Shortcuts in LLMs
by: Yan, Lecheng, et al.
Published: (2026)

Spurious Feature Diversification Improves Out-of-distribution Generalization
by: Lin, Yong, et al.
Published: (2023)

Precise Asymptotics for Spectral Methods in Mixed Generalized Linear Models
by: Zhang, Yihan, et al.
Published: (2022)

Shortcut Features as Top Eigenfunctions of NTK: A Linear Neural Network Case and More
by: Lim, Jinwoo, et al.
Published: (2026)

Complexity Matters: Dynamics of Feature Learning in the Presence of Spurious Correlations
by: Qiu, GuanWen, et al.
Published: (2024)

Spectral Estimators for Multi-Index Models: Precise Asymptotics and Optimal Weak Recovery
by: Kovačević, Filip, et al.
Published: (2025)

Not Only the Last-Layer Features for Spurious Correlations: All Layer Deep Feature Reweighting
by: Hameed, Humza Wajid, et al.
Published: (2024)

Challenges and Opportunities in Improving Worst-Group Generalization in Presence of Spurious Features
by: Joshi, Siddharth, et al.
Published: (2023)

Label-NTK Alignments and A Tighter Convergence Bound in the NTK Regime
by: Marreddy, Ruchirinkil, et al.
Published: (2026)

A Sober Look at the Robustness of CLIPs to Spurious Features
by: Wang, Qizhou, et al.
Published: (2024)

Uncovering Memorization Effect in the Presence of Spurious Correlations
by: You, Chenyu, et al.
Published: (2025)

High-dimensional Analysis of Synthetic Data Selection
by: Rezaei, Parham, et al.
Published: (2025)

Training NTK to Generalize with KARE
by: Schwab, Johannes, et al.
Published: (2025)

Freeze then Train: Towards Provable Representation Learning under Spurious Correlations and Feature Noise
by: Ye, Haotian, et al.
Published: (2022)

Theoretical Analysis of Robust Overfitting for Wide DNNs: An NTK Approach
by: Fu, Shaopeng, et al.
Published: (2023)

Optimal Regularization for Performative Learning
by: Cyffers, Edwige, et al.
Published: (2025)

DP-KAN: Differentially Private Kolmogorov-Arnold Networks
by: Kalinin, Nikita P., et al.
Published: (2024)

Adversarial Robustness of NTK Neural Networks
by: Hou, Yuxuan
Published: (2026)

Manifold Random Features
by: Parashar, Ananya, et al.
Published: (2026)

Matrix Denoising with Doubly Heteroscedastic Noise: Fundamental Limits and Optimal Spectral Methods
by: Zhang, Yihan, et al.
Published: (2024)

MLPs at the EOC: Spectrum of the NTK
by: Terjék, Dávid, et al.
Published: (2025)

MLPs at the EOC: Concentration of the NTK
by: Terjék, Dávid, et al.
Published: (2025)

Optimal Representation Size: High-Dimensional Analysis of Pretraining and Linear Probing
by: Njaradi, Valentina, et al.
Published: (2026)

Denoising Score Matching with Random Features: Insights on Diffusion Models from Precise Learning Curves
by: George, Anand Jerry, et al.
Published: (2025)

Understanding NTK Variance in Implicit Neural Representations
by: Ou, Chengguang, et al.
Published: (2025)

Random at First, Fast at Last: NTK-Guided Fourier Pre-Processing for Tabular DL
by: Sergazinov, Renat, et al.
Published: (2025)

General Graph Random Features
by: Reid, Isaac, et al.
Published: (2023)

Random Feature Representation Boosting
by: Zozoulenko, Nikita, et al.
Published: (2025)

Stein Random Feature Regression
by: Warren, Houston, et al.
Published: (2024)

Improved Convergence of Score-Based Diffusion Models via Prediction-Correction
by: Pedrotti, Francesco, et al.
Published: (2023)