Copertina

To Stay or Not to Stay in the Pre-train Basin: Insights on Ensembling in Transfer Learning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Sadrtdinov, Ildus, Pozdeev, Dmitrii, Vetrov, Dmitry, Lobacheva, Ekaterina
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

SGD as Free Energy Minimization: A Thermodynamic View on Neural Network Training
di: Sadrtdinov, Ildus, et al.
Pubblicazione: (2025)

Where Do Large Learning Rates Lead Us?
di: Sadrtdinov, Ildus, et al.
Pubblicazione: (2024)

Can Stationary Distributions of Scale-Invariant Neural Networks Be Described by the Thermodynamics of an Ideal Gas?
di: Sadrtdinov, Ildus, et al.
Pubblicazione: (2025)

Why Gaussian Diffusion Models Fail on Discrete Data and How to Prevent It?
di: Shabalin, Alexander, et al.
Pubblicazione: (2026)

Machine Learning and Statistical Insights into Hospital Stay Durations: The Italian EHR Case
di: Andric, Marina, et al.
Pubblicazione: (2025)

Stay Unique, Stay Efficient: Preserving Model Personality in Multi-Task Merging
di: Guo, Kuangpu, et al.
Pubblicazione: (2025)

Staying on the Manifold: Geometry-Aware Noise Injection
di: Jacobsen, Albert Kjøller, et al.
Pubblicazione: (2025)

Dyna-Style Safety Augmented Reinforcement Learning: Staying Safe in the Face of Uncertainty
di: Eisele, Artur, et al.
Pubblicazione: (2026)

Prediction of Hospital Associated Infections During Continuous Hospital Stays
di: Datta, Rituparna, et al.
Pubblicazione: (2025)

Staying Alive: Online Neural Network Maintenance and Systemic Drift
di: Hammond, Joshua E., et al.
Pubblicazione: (2025)

Learning to Stay Safe: Adaptive Regularization Against Safety Degradation during Fine-Tuning
di: Goel, Jyotin, et al.
Pubblicazione: (2026)

Neural Diffusion Models
di: Bartosh, Grigory, et al.
Pubblicazione: (2023)

SDE Matching: Scalable and Simulation-Free Training of Latent Stochastic Differential Equations
di: Bartosh, Grigory, et al.
Pubblicazione: (2025)

Lower Bounds and Optimal Algorithms for Non-Smooth Convex Decentralized Optimization over Time-Varying Networks
di: Kovalev, Dmitry, et al.
Pubblicazione: (2024)

Equitable Length of Stay Prediction for Patients with Learning Disabilities and Multiple Long-term Conditions Using Machine Learning
di: Abakasanga, Emeka, et al.
Pubblicazione: (2024)

Staying in the Sweet Spot: Responsive Reasoning Evolution via Capability-Adaptive Hint Scaffolding
di: Li, Ziheng, et al.
Pubblicazione: (2025)

Comparing Federated Stochastic Gradient Descent and Federated Averaging for Predicting Hospital Length of Stay
di: Balik, Mehmet Yigit
Pubblicazione: (2024)

Bridging Graph and State-Space Modeling for Intensive Care Unit Length of Stay Prediction
di: Zi, Shuqi, et al.
Pubblicazione: (2025)

Generative Flow Networks as Entropy-Regularized RL
di: Tiapkin, Daniil, et al.
Pubblicazione: (2023)

Regularized Distribution Matching Distillation for One-step Unpaired Image-to-Image Translation
di: Rakitin, Denis, et al.
Pubblicazione: (2024)

What Drives Length of Stay After Elective Spine Surgery? Insights from a Decade of Predictive Modeling
di: Cho, Ha Na, et al.
Pubblicazione: (2026)

Predicting the Stay Length of Patients in Hospitals using Convolutional Gated Recurrent Deep Learning Model
di: Neshat, Mehdi, et al.
Pubblicazione: (2024)

Area Modeling using Stay Information for Large-Scale Users and Analysis for Influence of COVID-19
di: Shoji, Kazuyuki, et al.
Pubblicazione: (2024)

Transfer Learning with Pre-trained Conditional Generative Models
di: Yamaguchi, Shin'ya, et al.
Pubblicazione: (2022)

Training Dynamics Underlying Language Model Scaling Laws: Loss Deceleration and Zero-Sum Learning
di: Mircea, Andrei, et al.
Pubblicazione: (2025)

Solving Reach-Avoid-Stay Problems Using Deep Deterministic Policy Gradients
di: Chenevert, Gabriel, et al.
Pubblicazione: (2024)

BadGPT-4o: stripping safety finetuning from GPT models
di: Krupkina, Ekaterina, et al.
Pubblicazione: (2024)

How to Stay Curious while Avoiding Noisy TVs using Aleatoric Uncertainty Estimation
di: Mavor-Parker, Augustine N., et al.
Pubblicazione: (2021)

Stay Fair! Ensuring Group Fairness in Diffusion Models Across Guidance Scales
di: Kim, Myeongsoo, et al.
Pubblicazione: (2026)

BPO: Staying Close to the Behavior LLM Creates Better Online LLM Alignment
di: Xu, Wenda, et al.
Pubblicazione: (2024)

Neural Flow Diffusion Models: Learnable Forward Process for Improved Diffusion Modelling
di: Bartosh, Grigory, et al.
Pubblicazione: (2024)

Streaming Generation of Co-Speech Gestures via Accelerated Rolling Diffusion
di: Vu, Evgeniia, et al.
Pubblicazione: (2025)

Prediction of Significant Creatinine Elevation in First ICU Stays with Vancomycin Use: A retrospective study through Catboost
di: Fan, Junyi, et al.
Pubblicazione: (2025)

A Hybrid Data-Driven Approach For Analyzing And Predicting Inpatient Length Of Stay In Health Centre
di: Chowdhury, Tasfia Noor, et al.
Pubblicazione: (2025)

Predicting Length of Stay in Neurological ICU Patients Using Classical Machine Learning and Neural Network Models: A Benchmark Study on MIMIC-IV
di: Gabitashvili, Alexander, et al.
Pubblicazione: (2025)

Stay Tuned: An Empirical Study of the Impact of Hyperparameters on LLM Tuning in Real-World Applications
di: Halfon, Alon, et al.
Pubblicazione: (2024)

SOPHON: Non-Fine-Tunable Learning to Restrain Task Transferability For Pre-trained Models
di: Deng, Jiangyi, et al.
Pubblicazione: (2024)

Provable Benefits of Unsupervised Pre-training and Transfer Learning via Single-Index Models
di: Jones-McCormick, Taj, et al.
Pubblicazione: (2025)

Learning While Staying Curious: Entropy-Preserving Supervised Fine-Tuning via Adaptive Self-Distillation for Large Reasoning Models
di: Wang, Hao, et al.
Pubblicazione: (2026)

A Log-Linear Analytics Approach to Cost Model Regularization for Inpatient Stays through Diagnostic Code Merging
di: Lu, Chi-Ken, et al.
Pubblicazione: (2025)