Imagen de Portada

Kernel ridge regression under power-law data: spectrum and generalization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Wortsman, Arie, Loureiro, Bruno
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

A Random Matrix Theory of Masked Self-Supervised Regression
por: Zurich, Arie Wortsman, et al.
Publicado: (2026)

Scaling Laws from Sequential Feature Recovery: A Solvable Hierarchical Model
por: Wortsman-Zurich, Arie, et al.
Publicado: (2026)

Dimension-free deterministic equivalents and scaling laws for random feature regression
por: Defilippis, Leonardo, et al.
Publicado: (2024)

High-dimensional robust regression under heavy-tailed data: Asymptotics and Universality
por: Adomaityte, Urte, et al.
Publicado: (2023)

Universality laws for Gaussian mixtures in generalized linear models
por: Dandi, Yatin, et al.
Publicado: (2023)

Uniform convergence for Gaussian kernel ridge regression
por: Dommel, Paul, et al.
Publicado: (2025)

Prevalidated ridge regression is a highly-efficient drop-in replacement for logistic regression for high-dimensional data
por: Dempster, Angus, et al.
Publicado: (2024)

Optimal scaling laws in learning hierarchical multi-index models
por: Defilippis, Leonardo, et al.
Publicado: (2026)

Pack only the essentials: Adaptive dictionary learning for kernel ridge regression
por: Calandriello, Daniele, et al.
Publicado: (2026)

Dimension free ridge regression
por: Cheng, Chen, et al.
Publicado: (2022)

Risk and cross validation in ridge regression with correlated samples
por: Atanasov, Alexander, et al.
Publicado: (2024)

High-dimensional analysis of ridge regression for non-identically distributed data with a variance profile
por: Bigot, Jérémie, et al.
Publicado: (2024)

Learning solution operator of dynamical systems with diffusion maps kernel ridge regression
por: Song, Jiwoo, et al.
Publicado: (2025)

Escaping mediocrity: how two-layer networks learn hard generalized linear models with SGD
por: Arnaboldi, Luca, et al.
Publicado: (2023)

High-dimensional ridge regression with random features for non-identically distributed data with a variance profile
por: Dabo, Issa-Mbenard, et al.
Publicado: (2025)

Robust, randomized preconditioning for kernel ridge regression
por: Díaz, Mateo, et al.
Publicado: (2023)

Breaking the curse of dimensionality for linear rules: optimal predictors over the ellipsoid
por: Ayme, Alexis, et al.
Publicado: (2025)

Fast Escape, Slow Convergence: Learning Dynamics of Phase Retrieval under Power-Law Data
por: Braun, Guillaume, et al.
Publicado: (2025)

Comparing regularisation paths of (conjugate) gradient estimators in ridge regression
por: Hucker, Laura, et al.
Publicado: (2025)

Optimal ridge regularization revisited
por: Timmermans, Jack, et al.
Publicado: (2026)

Optimal ridge penalty for real-world high-dimensional data can be zero or negative due to the implicit ridge regularization
por: Kobak, Dmitry, et al.
Publicado: (2018)

Annealing in variational inference mitigates mode collapse: A theoretical study on Gaussian mixtures
por: Fogliani, Luigi, et al.
Publicado: (2026)

Reproducible scaling laws for contrastive language-image learning
por: Cherti, Mehdi, et al.
Publicado: (2022)

Scaling up ridge regression for brain encoding in a massive individual fMRI dataset
por: Ahmadi, Sana, et al.
Publicado: (2024)

Fair regression under localized demographic parity constraints
por: Charpentier, Arthur, et al.
Publicado: (2026)

Analysis of Nystrom method with sequential ridge leverage scores
por: Calandriello, Daniele, et al.
Publicado: (2026)

Learning curves theory for hierarchically compositional data with power-law distributed features
por: Cagnetta, Francesco, et al.
Publicado: (2025)

A Noise Sensitivity Exponent Controls Large Statistical-to-Computational Gaps in Single- and Multi-Index Models
por: Defilippis, Leonardo, et al.
Publicado: (2026)

Resolving Discrepancies in Compute-Optimal Scaling of Language Models
por: Porian, Tomer, et al.
Publicado: (2024)

Interpretable Tabular Foundation Models via In-Context Kernel Regression
por: Miftachov, Ratmir, et al.
Publicado: (2026)

Robust Kernel Hypothesis Testing under Data Corruption
por: Schrab, Antonin, et al.
Publicado: (2024)

Flexible Deep Neural Networks for Partially Linear Survival Data: Estimation and Survival Inference
por: Arie, Asaf Ben, et al.
Publicado: (2025)

Confidence Intervals and Simultaneous Confidence Bands Based on Deep Learning
por: Arie, Asaf Ben, et al.
Publicado: (2024)

How does feature learning reshape the function space?
por: Lobo, João, et al.
Publicado: (2026)

Boosting methods for interval-censored data with regression and classification
por: Bian, Yuan, et al.
Publicado: (2026)

Heavy Lasso: sparse penalized regression under heavy-tailed noise via data-augmented soft-thresholding
por: Mai, The Tien
Publicado: (2025)

The Stochastic Occupation Kernel Method for System Identification
por: Wells, Michael, et al.
Publicado: (2024)

Improved large-scale graph learning through ridge spectral sparsification
por: Calandriello, Daniele, et al.
Publicado: (2026)

Computational Efficiency under Covariate Shift in Kernel Ridge Regression
por: Della Vecchia, Andrea, et al.
Publicado: (2025)

Precise analysis of ridge interpolators under heavy correlations -- a Random Duality Theory view
por: Stojnic, Mihailo
Publicado: (2024)