Cover Image

Generalization in Representation Models via Random Matrix Theory: Application to Recurrent Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Moakher, Yessin, Tiomoko, Malik, Louart, Cosme, Liao, Zhenyu
Format:	Preprint
Published:	2025
Subjects:	Statistics Theory Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Random Matrix Perspective of Echo State Networks: From Precise Bias--Variance Characterization to Optimal Regularization
by: Moakher, Yessin, et al.
Published: (2025)

Characterization of Gaussian Universality Breakdown in High-Dimensional Empirical Risk Minimization
by: Yaakoubi, Chiheb, et al.
Published: (2026)

Analysing Multi-Task Regression via Random Matrix Theory with Application to Time Series Forecasting
by: Ilbert, Romain, et al.
Published: (2024)

A Random Matrix Theory Perspective on the Spectrum of Learned Features and Asymptotic Generalization Capabilities
by: Dandi, Yatin, et al.
Published: (2024)

Random Matrix Theory of Early-Stopped Gradient Flow: A Transient BBP Scenario
by: Coeurdoux, Florentin, et al.
Published: (2026)

UTICA: Multi-Objective Self-Distllation Foundation Model Pretraining for Time Series Classification
by: Moakher, Yessin, et al.
Published: (2026)

High-Dimensional Analysis of Bootstrap Ensemble Classifiers
by: Tiomoko, Malik, et al.
Published: (2025)

Maximizing the Potential of Synthetic Data: Insights from Random Matrix Theory
by: Firdoussi, Aymane El, et al.
Published: (2024)

Leveraging Generic Time Series Foundation Models for EEG Classification
by: Gnassounou, Théo, et al.
Published: (2025)

Universal concentration for sums under arbitrary dependence
by: Louart, Cosme, et al.
Published: (2026)

Robust Tensor Principal Component Analysis: Exact Recovery via Deterministic Model
by: Shen, Bo, et al.
Published: (2020)

Resolvent convergence for sample covariance matrices with general covariance profiles and quadratic-form control
by: Louart, Cosme
Published: (2021)

Signal-Plus-Noise Decomposition of Nonlinear Spiked Random Matrix Models
by: Moniri, Behrad, et al.
Published: (2024)

Rapidly Varying Completely Random Measures for Modeling Extremely Sparse Networks
by: Kilian, Valentin, et al.
Published: (2025)

On the Interpolation Error of Nonlinear Attention versus Linear Regression
by: Liao, Zhenyu, et al.
Published: (2025)

A Generative Approach to Quasi-Random Sampling from Copulas via Space-Filling Designs
by: Wang, Sumin, et al.
Published: (2024)

Asymptotic Optimism for Tensor Regression Models with Applications to Neural Network Compression
by: Shi, Haoming, et al.
Published: (2026)

Provable Sample-Efficient Transfer Learning Conditional Diffusion Models via Representation Learning
by: Cheng, Ziheng, et al.
Published: (2025)

Intrinsic Bayesian Cramér-Rao Bound with an Application to Covariance Matrix Estimation
by: Bouchard, Florent, et al.
Published: (2023)

An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization
by: Chen, Minshuo, et al.
Published: (2024)

A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Models
by: Suh, Namjoon, et al.
Published: (2024)

Multivariate Stochastic Dominance via Optimal Transport and Applications to Models Benchmarking
by: Rioux, Gabriel, et al.
Published: (2024)

Learning with Expected Signatures: Theory and Applications
by: Lucchese, Lorenzo, et al.
Published: (2025)

Revisiting Theory of Contrastive Learning for Domain Generalization
by: Alvandi, Ali, et al.
Published: (2025)

Inference for Deep Neural Network Estimators in Generalized Nonparametric Models
by: Meng, Xuran, et al.
Published: (2025)

Convergence of the Inexact Langevin Algorithm in KL Divergence with Application to Score-based Generative Models
by: Yang, Kaylee Yingxi, et al.
Published: (2022)

Precise analysis of ridge interpolators under heavy correlations -- a Random Duality Theory view
by: Stojnic, Mihailo
Published: (2024)

Generalized Bayesian Additive Regression Trees: Theory and Software
by: Saha, Enakshi
Published: (2023)

Streaming data recovery via Bayesian tensor train decomposition
by: Huang, Yunyu, et al.
Published: (2023)

Characterizing the Generalization Error of Random Feature Regression with Arbitrary Data-Augmentation
by: Morisset, Lucas, et al.
Published: (2026)

Exogenous Randomness Empowering Random Forests
by: Mei, Tianxing, et al.
Published: (2024)

Confidence Sequences for Generalized Linear Models via Regret Analysis
by: Clerico, Eugenio, et al.
Published: (2025)

Bayesian Models for Joint Selection of Features and Auto-Regressive Lags: Theory and Applications in Environmental and Financial Forecasting
by: Manna, Alokesh, et al.
Published: (2025)

A Statistical Theory of Contrastive Pre-training and Multimodal Generative AI
by: Oko, Kazusato, et al.
Published: (2025)

On Transferring Transferability: Towards a Theory for Size Generalization
by: Levin, Eitan, et al.
Published: (2025)

A Statistical Theory of Contrastive Learning via Approximate Sufficient Statistics
by: Lin, Licong, et al.
Published: (2025)

Transfer Learning with Distance Covariance for Random Forest: Error Bounds and an EHR Application
by: Li, Chenze, et al.
Published: (2025)

High-dimensional Asymptotics of Langevin Dynamics in Spiked Matrix Models
by: Liang, Tengyuan, et al.
Published: (2022)

Towards a Statistical Understanding of Neural Networks: Beyond the Neural Tangent Kernel Theories
by: Zhang, Haobo, et al.
Published: (2024)

Orthogonal Approximate Message Passing with Optimal Spectral Initializations for Rectangular Spiked Matrix Models
by: Chen, Haohua, et al.
Published: (2025)