Image de couverture de livre

Transfer Learning of Linear Regression with Multiple Pretrained Models: Benefiting from More Pretrained Models via Overparameterization Debiasing

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Boharon, Daniel, Dar, Yehuda
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

How Does Overparameterization Affect Machine Unlearning of Deep Neural Networks?
par: Alon, Gal, et autres
Publié: (2025)

The Common Intuition to Transfer Learning Can Win or Lose: Case Studies for Linear Regression
par: Dar, Yehuda, et autres
Publié: (2021)

How Much Training Data is Memorized in Overparameterized Autoencoders? An Inverse Problem Perspective on Memorization Evaluation
par: Abitbul, Koren, et autres
Publié: (2023)

TL-PCA: Transfer Learning of Principal Component Analysis
par: Hendy, Sharon, et autres
Publié: (2024)

Overparameterized Multiple Linear Regression as Hyper-Curve Fitting
par: Atza, E., et autres
Publié: (2024)

Mixture of Many Zero-Compute Experts: A High-Rate Quantization Theory Perspective
par: Dar, Yehuda
Publié: (2025)

Task Shift: From Classification to Regression in Overparameterized Linear Models
par: LaBonte, Tyler, et autres
Publié: (2025)

Benefits of Early Stopping in Gradient Descent for Overparameterized Logistic Regression
par: Wu, Jingfeng, et autres
Publié: (2025)

How Do the Architecture and Optimizer Affect Representation Learning? On the Training Dynamics of Representations in Deep Neural Networks
par: Sharon, Yuval, et autres
Publié: (2024)

How Many Pretraining Tasks Are Needed for In-Context Learning of Linear Regression?
par: Wu, Jingfeng, et autres
Publié: (2023)

Learning Transferable Sensor Models via Language-Informed Pretraining
par: Chen, Yuliang, et autres
Publié: (2026)

Analysis of Overparameterization in Continual Learning under a Linear Model
par: Goldfarb, Daniel, et autres
Publié: (2025)

CARTE: Pretraining and Transfer for Tabular Learning
par: Kim, Myung Jun, et autres
Publié: (2024)

Probabilistic Pretraining for Neural Regression
par: Oreshkin, Boris N., et autres
Publié: (2025)

Simplifying Knowledge Transfer in Pretrained Models
par: Jain, Siddharth, et autres
Publié: (2025)

Multiple Physics Pretraining for Physical Surrogate Models
par: McCabe, Michael, et autres
Publié: (2023)

Value Explicit Pretraining for Learning Transferable Representations
par: Lekkala, Kiran, et autres
Publié: (2023)

Narrowing the Focus: Learned Optimizers for Pretrained Models
par: Kristiansen, Gus, et autres
Publié: (2024)

Precise Asymptotic Generalization for Multiclass Classification with Overparameterized Linear Models
par: Wu, David X., et autres
Publié: (2023)

More is Less: Inducing Sparsity via Overparameterization
par: Chou, Hung-Hsu, et autres
Publié: (2021)

Double Descent and Other Interpolation Phenomena in GANs
par: Luzi, Lorenzo, et autres
Publié: (2021)

Learning with Incomplete Context: Linear Contextual Bandits with Pretrained Imputation
par: Yan, Hao, et autres
Publié: (2025)

Unified Transfer Learning Models in High-Dimensional Linear Regression
par: Liu, Shuo Shuo
Publié: (2023)

Why Fine-grained Labels in Pretraining Benefit Generalization?
par: Hong, Guan Zhe, et autres
Publié: (2024)

On the Benefits of Weight Normalization for Overparameterized Matrix Sensing
par: Wei, Yudong, et autres
Publié: (2025)

An Analytical Model for Overparameterized Learning Under Class Imbalance
par: Mor, Eliav, et autres
Publié: (2025)

Enhancing Pretrained Model-based Continual Representation Learning via Guided Random Projection
par: Li, Ruilin, et autres
Publié: (2026)

Batches Stabilize the Minimum Norm Risk in High Dimensional Overparameterized Linear Regression
par: Ioushua, Shahar Stein, et autres
Publié: (2023)

Boosting Statistic Learning with Synthetic Data from Pretrained Large Models
par: Jiang, Jialong, et autres
Publié: (2025)

Benchmarking Optimizers for Large Language Model Pretraining
par: Semenov, Andrei, et autres
Publié: (2025)

Initial Model Incorporation for Deep Learning FWI: Pretraining or Denormalization?
par: Chen, Ruihua, et autres
Publié: (2025)

The Interpolating Information Criterion for Overparameterized Models
par: Hodgkinson, Liam, et autres
Publié: (2023)

Bayesian Inference for Consistent Predictions in Overparameterized Nonlinear Regression
par: Wakayama, Tomoya
Publié: (2024)

More is Better in Modern Machine Learning: when Infinite Overparameterization is Optimal and Overfitting is Obligatory
par: Simon, James B., et autres
Publié: (2023)

Unveiling Markov Heads in Pretrained Language Models for Offline Reinforcement Learning
par: Zhao, Wenhao, et autres
Publié: (2024)

Quick-Tune: Quickly Learning Which Pretrained Model to Finetune and How
par: Arango, Sebastian Pineda, et autres
Publié: (2023)

Boosting Relational Deep Learning with Pretrained Tabular Models
par: Lachi, Veronica, et autres
Publié: (2025)

Towards Foundation Models on Graphs: An Analysis on Cross-Dataset Transfer of Pretrained GNNs
par: Frasca, Fabrizio, et autres
Publié: (2024)

Soup-of-Experts: Pretraining Specialist Models via Parameters Averaging
par: Ablin, Pierre, et autres
Publié: (2025)

Projection-Free CNN Pruning via Frank-Wolfe with Momentum: Sparser Models with Less Pretraining
par: Shili, Hamza ElMokhtar, et autres
Publié: (2025)