Cover Image

A Random Matrix Theory of Masked Self-Supervised Regression

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zurich, Arie Wortsman, Gerace, Federica, Loureiro, Bruno, Lu, Yue M.
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Scaling Laws from Sequential Feature Recovery: A Solvable Hierarchical Model
by: Wortsman-Zurich, Arie, et al.
Published: (2026)

Kernel ridge regression under power-law data: spectrum and generalization
by: Wortsman, Arie, et al.
Published: (2025)

Gaussian Universality of Perceptrons with Random Labels
by: Gerace, Federica, et al.
Published: (2022)

A Random Matrix Theory Perspective on the Spectrum of Learned Features and Asymptotic Generalization Capabilities
by: Dandi, Yatin, et al.
Published: (2024)

Analysing Multi-Task Regression via Random Matrix Theory with Application to Time Series Forecasting
by: Ilbert, Romain, et al.
Published: (2024)

Matrix Information Theory for Self-Supervised Learning
by: Zhang, Yifan, et al.
Published: (2023)

Learning from higher-order statistics, efficiently: hypothesis tests, random features, and neural networks
by: Székely, Eszter, et al.
Published: (2023)

Asymptotics of Random Feature Regression Beyond the Linear Scaling Regime
by: Hu, Hong, et al.
Published: (2024)

Self-Supervised Learning for Sparse Matrix Reordering
by: Li, Ziwei, et al.
Published: (2026)

Bias-inducing geometries: an exactly solvable data model with fairness implications
by: Mannelli, Stefano Sarao, et al.
Published: (2022)

Self-Guided Masked Autoencoders for Domain-Agnostic Self-Supervised Learning
by: Xie, Johnathan, et al.
Published: (2024)

Mapping of attention mechanisms to a generalized Potts model
by: Rende, Riccardo, et al.
Published: (2023)

TimeMAE: Self-Supervised Representations of Time Series with Decoupled Masked Autoencoders
by: Cheng, Mingyue, et al.
Published: (2023)

Breaking the curse of dimensionality for linear rules: optimal predictors over the ellipsoid
by: Ayme, Alexis, et al.
Published: (2025)

Auto-Regressive Masked Diffusion Models
by: Karami, Mahdi, et al.
Published: (2026)

Random Matrix Theory for Deep Learning: Beyond Eigenvalues of Linear Models
by: Liao, Zhenyu, et al.
Published: (2025)

Beyond Labels: A Self-Supervised Framework with Masked Autoencoders and Random Cropping for Breast Cancer Subtype Classification
by: Chiocchetti, Annalisa, et al.
Published: (2024)

A Random Matrix Theory Perspective on the Learning Dynamics of Multi-head Latent Attention
by: Jha, Nandan Kumar, et al.
Published: (2025)

Mixture Experts with Test-Time Self-Supervised Aggregation for Tabular Imbalanced Regression
by: Wang, Yung-Chien, et al.
Published: (2025)

An Augmentation-Aware Theory for Self-Supervised Contrastive Learning
by: Cui, Jingyi, et al.
Published: (2025)

Towards Self-Supervised Covariance Estimation in Deep Heteroscedastic Regression
by: Shukla, Megh, et al.
Published: (2025)

Enhancing Accuracy in Deep Learning Using Random Matrix Theory
by: Berlyand, Leonid, et al.
Published: (2023)

CroSSL: Cross-modal Self-Supervised Learning for Time-series through Latent Masking
by: Deldari, Shohreh, et al.
Published: (2023)

Beyond Accuracy: A Unified Random Matrix Theory Diagnostic Framework for Crash Classification Models
by: Shihab, Ibne Farabi, et al.
Published: (2026)

Annealing in variational inference mitigates mode collapse: A theoretical study on Gaussian mixtures
by: Fogliani, Luigi, et al.
Published: (2026)

Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression
by: Zhai, Runtian, et al.
Published: (2023)

Asymptotics of Learning with Deep Structured (Random) Features
by: Schröder, Dominik, et al.
Published: (2024)

Analysis of Bootstrap and Subsampling in High-dimensional Regularized Regression
by: Clarté, Lucas, et al.
Published: (2024)

Evaluating Singular Value Thresholds for DNN Weight Matrices based on Random Matrix Theory
by: Nishikawa, Kohei, et al.
Published: (2025)

On Reward Transferability in Adversarial Inverse Reinforcement Learning: Insights from Random Matrix Theory
by: Zhang, Yangchun, et al.
Published: (2024)

Self-Supervised Learning on Molecular Graphs: A Systematic Investigation of Masking Design
by: Yang, Jiannan, et al.
Published: (2025)

Applications of Random Matrix Theory in Machine Learning and Brain Mapping
by: Lawrence, Katrina
Published: (2025)

Masked-and-Reordered Self-Supervision for Reinforcement Learning from Verifiable Rewards
by: Wang, Zhen, et al.
Published: (2025)

Selective Masking based Self-Supervised Learning for Image Semantic Segmentation
by: Wang, Yuemin, et al.
Published: (2025)

Stein Random Feature Regression
by: Warren, Houston, et al.
Published: (2024)

Random Matrix Theory of Early-Stopped Gradient Flow: A Transient BBP Scenario
by: Coeurdoux, Florentin, et al.
Published: (2026)

Generalization in Representation Models via Random Matrix Theory: Application to Recurrent Networks
by: Moakher, Yessin, et al.
Published: (2025)

Self-Speculative Masked Diffusions
by: Campbell, Andrew, et al.
Published: (2025)

Asymptotic Theory of Iterated Empirical Risk Minimization, with Applications to Active Learning
by: Cui, Hugo, et al.
Published: (2026)

Semi-Supervised Regression with Heteroscedastic Pseudo-Labels
by: Sun, Xueqing, et al.
Published: (2025)