Near-Interpolators: Rapid Norm Growth and the Trade-Off between Interpolation and Generalization
Fuente:
arXiv
Guardado en:
| Autores principales: | Wang, Yutong, Sonthalia, Rishi, Hu, Wei |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Generalization for Least Squares Regression With Simple Spiked Covariances
por: Li, Jiping, et al.
Publicado: (2024)
por: Li, Jiping, et al.
Publicado: (2024)
Least Squares Regression Can Exhibit Under-Parameterized Double Descent
por: Li, Xinyue, et al.
Publicado: (2023)
por: Li, Xinyue, et al.
Publicado: (2023)
Risk Phase Transitions in Spiked Regression: Alignment Driven Benign and Catastrophic Overfitting
por: Li, Jiping, et al.
Publicado: (2025)
por: Li, Jiping, et al.
Publicado: (2025)
Minimum-Norm Interpolation Under Covariate Shift
por: Mallinar, Neil, et al.
Publicado: (2024)
por: Mallinar, Neil, et al.
Publicado: (2024)
Matricial Free Energy as a Gaussianizing Regularizer: Enhancing Autoencoders for Gaussian Code Generation
por: Sonthalia, Rishi, et al.
Publicado: (2025)
por: Sonthalia, Rishi, et al.
Publicado: (2025)
Error dynamics of mini-batch gradient descent with random reshuffling for least squares regression
por: Lok, Jackie, et al.
Publicado: (2024)
por: Lok, Jackie, et al.
Publicado: (2024)
Double Descent and Overfitting under Noisy Inputs and Distribution Shift for Linear Denoisers
por: Kausik, Chinmaya, et al.
Publicado: (2023)
por: Kausik, Chinmaya, et al.
Publicado: (2023)
Low Rank Gradients and Where to Find Them
por: Sonthalia, Rishi, et al.
Publicado: (2025)
por: Sonthalia, Rishi, et al.
Publicado: (2025)
On Regularization via Early Stopping for Least Squares Regression
por: Sonthalia, Rishi, et al.
Publicado: (2024)
por: Sonthalia, Rishi, et al.
Publicado: (2024)
A Theoretical Framework for Grokking: Interpolation followed by Riemannian Norm Minimisation
por: Boursier, Etienne, et al.
Publicado: (2025)
por: Boursier, Etienne, et al.
Publicado: (2025)
Sufficient Conditions for Stability of Minimum-Norm Interpolating Deep ReLU Networks
por: Harzli, Ouns El, et al.
Publicado: (2026)
por: Harzli, Ouns El, et al.
Publicado: (2026)
A Regularization-Sharpness Tradeoff for Linear Interpolators
por: Hu, Qingyi, et al.
Publicado: (2026)
por: Hu, Qingyi, et al.
Publicado: (2026)
Universal Approximation of Mean-Field Models via Transformers
por: Biswal, Shiba, et al.
Publicado: (2024)
por: Biswal, Shiba, et al.
Publicado: (2024)
Latent Stochastic Interpolants
por: Singh, Saurabh, et al.
Publicado: (2025)
por: Singh, Saurabh, et al.
Publicado: (2025)
Generalized Interpolating Discrete Diffusion
por: von Rütte, Dimitri, et al.
Publicado: (2025)
por: von Rütte, Dimitri, et al.
Publicado: (2025)
Open Materials Generation with Stochastic Interpolants
por: Hoellmer, Philipp, et al.
Publicado: (2025)
por: Hoellmer, Philipp, et al.
Publicado: (2025)
General Loss Functions Lead to (Approximate) Interpolation in High Dimensions
por: Lai, Kuo-Wei, et al.
Publicado: (2023)
por: Lai, Kuo-Wei, et al.
Publicado: (2023)
From Interpolation to Extrapolation: Complete Length Generalization for Arithmetic Transformers
por: Duan, Shaoxiong, et al.
Publicado: (2023)
por: Duan, Shaoxiong, et al.
Publicado: (2023)
Finite-Time Convergence Analysis of ODE-based Generative Models for Stochastic Interpolants
por: Liu, Yuhao, et al.
Publicado: (2025)
por: Liu, Yuhao, et al.
Publicado: (2025)
Local Linear Attention: An Optimal Interpolation of Linear and Softmax Attention For Test-Time Regression
por: Zuo, Yifei, et al.
Publicado: (2025)
por: Zuo, Yifei, et al.
Publicado: (2025)
In Search of the Successful Interpolation: On the Role of Sharpness in CLIP Generalization
por: Abdollahpoorrostam, Alireza
Publicado: (2024)
por: Abdollahpoorrostam, Alireza
Publicado: (2024)
Continual Learning with Weight Interpolation
por: Kozal, Jędrzej, et al.
Publicado: (2024)
por: Kozal, Jędrzej, et al.
Publicado: (2024)
Principled Interpolation in Normalizing Flows
por: Fadel, Samuel G., et al.
Publicado: (2020)
por: Fadel, Samuel G., et al.
Publicado: (2020)
Stochastic Interpolants in Hilbert Spaces
por: Yu, James Boran, et al.
Publicado: (2026)
por: Yu, James Boran, et al.
Publicado: (2026)
Riemannian Neural Geodesic Interpolant
por: Wu, Jiawen, et al.
Publicado: (2025)
por: Wu, Jiawen, et al.
Publicado: (2025)
Recurrent Interpolants for Probabilistic Time Series Prediction
por: Chen, Yu, et al.
Publicado: (2024)
por: Chen, Yu, et al.
Publicado: (2024)
Finite-Time Analysis of Discrete-Time Stochastic Interpolants
por: Liu, Yuhao, et al.
Publicado: (2025)
por: Liu, Yuhao, et al.
Publicado: (2025)
On Interpolation Formulas Describing Neural Network Generalization
por: Guo, Jin, et al.
Publicado: (2026)
por: Guo, Jin, et al.
Publicado: (2026)
Interpolation-Based Optimization for Enforcing lp-Norm Metric Differential Privacy in Continuous and Fine-Grained Domains
por: Qiu, Chenxi
Publicado: (2026)
por: Qiu, Chenxi
Publicado: (2026)
RetroDiff: Retrosynthesis as Multi-stage Distribution Interpolation
por: Wang, Yiming, et al.
Publicado: (2023)
por: Wang, Yiming, et al.
Publicado: (2023)
Training-Free Generative Modeling via Kernelized Stochastic Interpolants
por: Coeurdoux, Florentin, et al.
Publicado: (2026)
por: Coeurdoux, Florentin, et al.
Publicado: (2026)
On Conditional Stochastic Interpolation for Generative Nonlinear Sufficient Dimension Reduction
por: Xu, Shuntuo, et al.
Publicado: (2025)
por: Xu, Shuntuo, et al.
Publicado: (2025)
Reframing Generative Models for Physical Systems using Stochastic Interpolants
por: Zhou, Anthony, et al.
Publicado: (2025)
por: Zhou, Anthony, et al.
Publicado: (2025)
Conditional Stochastic Interpolation for Generative Learning
por: Huang, Ding, et al.
Publicado: (2023)
por: Huang, Ding, et al.
Publicado: (2023)
Interpolated-MLPs: Controllable Inductive Bias
por: Wu, Sean, et al.
Publicado: (2024)
por: Wu, Sean, et al.
Publicado: (2024)
Tighter Generalisation Bounds via Interpolation
por: Viallard, Paul, et al.
Publicado: (2024)
por: Viallard, Paul, et al.
Publicado: (2024)
The Interpolating Information Criterion for Overparameterized Models
por: Hodgkinson, Liam, et al.
Publicado: (2023)
por: Hodgkinson, Liam, et al.
Publicado: (2023)
Physics-informed Diffusion Generation for Geomagnetic Map Interpolation
por: Li, Wenda, et al.
Publicado: (2026)
por: Li, Wenda, et al.
Publicado: (2026)
Lipschitz-Guided Design of Interpolation Schedules in Generative Models
por: Chen, Yifan, et al.
Publicado: (2025)
por: Chen, Yifan, et al.
Publicado: (2025)
PAC-Chernoff Bounds: Understanding Generalization in the Interpolation Regime
por: Masegosa, Andrés R., et al.
Publicado: (2023)
por: Masegosa, Andrés R., et al.
Publicado: (2023)
Ejemplares similares
-
Generalization for Least Squares Regression With Simple Spiked Covariances
por: Li, Jiping, et al.
Publicado: (2024) -
Least Squares Regression Can Exhibit Under-Parameterized Double Descent
por: Li, Xinyue, et al.
Publicado: (2023) -
Risk Phase Transitions in Spiked Regression: Alignment Driven Benign and Catastrophic Overfitting
por: Li, Jiping, et al.
Publicado: (2025) -
Minimum-Norm Interpolation Under Covariate Shift
por: Mallinar, Neil, et al.
Publicado: (2024) -
Matricial Free Energy as a Gaussianizing Regularizer: Enhancing Autoencoders for Gaussian Code Generation
por: Sonthalia, Rishi, et al.
Publicado: (2025)