Cover Image

A Bayesian Model Selection Criterion for Selecting Pretraining Checkpoints

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Munn, Michael, Wei, Susan
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Order Selection in Vector Autoregression by Mean Square Information Criterion
by: Hellstern, Michael, et al.
Published: (2025)

On the Laplace Approximation as Model Selection Criterion for Gaussian Processes
by: Besginow, Andreas, et al.
Published: (2024)

Uncertainty-Guided Checkpoint Selection for Reinforcement Finetuning of Large Language Models
by: Nguyen, Manh, et al.
Published: (2025)

ESLM: Risk-Averse Selective Language Modeling for Efficient Pretraining
by: Bal, Melis Ilayda, et al.
Published: (2025)

Bayesian Online Model Selection
by: Afshar, Aida, et al.
Published: (2026)

BLISS: A Lightweight Bilevel Influence Scoring Method for Data Selection in Language Model Pretraining
by: Hao, Jie, et al.
Published: (2025)

On residual network depth
by: Dherin, Benoit, et al.
Published: (2025)

Enhancing Offline Model-Based RL via Active Model Selection: A Bayesian Optimization Perspective
by: Yang, Yu-Wei, et al.
Published: (2025)

Enhancing Multilingual LLM Pretraining with Model-Based Data Selection
by: Messmer, Bettina, et al.
Published: (2025)

Analyzing Similarity Metrics for Data Selection for Language Model Pretraining
by: Sam, Dylan, et al.
Published: (2025)

PMSS: Pretrained Matrices Skeleton Selection for LLM Fine-tuning
by: Wang, Qibin, et al.
Published: (2024)

A Margin-based Multiclass Generalization Bound via Geometric Complexity
by: Munn, Michael, et al.
Published: (2024)

Group-Level Data Selection for Efficient Pretraining
by: Yu, Zichun, et al.
Published: (2025)

Continuous Bayesian Model Selection for Multivariate Causal Discovery
by: Dhir, Anish, et al.
Published: (2024)

Bivariate Causal Discovery using Bayesian Model Selection
by: Dhir, Anish, et al.
Published: (2023)

MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models
by: Yu, Zichun, et al.
Published: (2024)

Gradient-based Sample Selection for Faster Bayesian Optimization
by: Wei, Qiyu, et al.
Published: (2025)

A Bayesian Approach to Data Point Selection
by: Xu, Xinnuo, et al.
Published: (2024)

The Interpolating Information Criterion for Overparameterized Models
by: Hodgkinson, Liam, et al.
Published: (2023)

The Impact of Geometric Complexity on Neural Collapse in Transfer Learning
by: Munn, Michael, et al.
Published: (2024)

Clustered FedStack: Intermediate Global Models with Bayesian Information Criterion
by: Shaik, Thanveer, et al.
Published: (2023)

A Two-Phase Recall-and-Select Framework for Fast Model Selection
by: Cui, Jianwei, et al.
Published: (2024)

StackFeat RL: Reinforcement Learning over Iterative Dual Criterion Feature Selection for Stable Biomarker Discovery
by: Yermekov, A., et al.
Published: (2026)

Mordal: Automated Pretrained Model Selection for Vision Language Models
by: He, Shiqi, et al.
Published: (2025)

Robust Checkpoint Selection for Multimodal LLMs via Agentic Evaluation and Stability-Aware Ranking
by: Xu, Qinwu, et al.
Published: (2026)

Adaptive Acquisition Selection for Bayesian Optimization with Large Language Models
by: Ngo, Giang, et al.
Published: (2026)

Overcoming Selection Bias in Statistical Studies With Amortized Bayesian Inference
by: Arruda, Jonas, et al.
Published: (2026)

TopoGeoScore: A Self-Supervised Source-Only Geometric Framework for OOD Checkpoint Selection
by: Hazratian, Farid, et al.
Published: (2026)

Towards Bayesian Data Selection
by: Rodemann, Julian
Published: (2024)

Equivalence of Context and Parameter Updates in Modern Transformer Blocks
by: Goldwaser, Adrian, et al.
Published: (2025)

Concurrent Criterion Validation of a Validity Screen for LLM Confidence Signals via Selective Prediction
by: Cacioli, Jon-Paul
Published: (2026)

Quotient Normalized Maximum Likelihood Criterion for Learning Bayesian Network Structures
by: Silander, Tomi, et al.
Published: (2024)

Basis Selection: Low-Rank Decomposition of Pretrained Large Language Models for Target Applications
by: Li, Yang, et al.
Published: (2024)

Type 2 Tobit Sample Selection Models with Bayesian Additive Regression Trees
by: O'Neill, Eoghan
Published: (2025)

Fair Bayesian Data Selection via Generalized Discrepancy Measures
by: Zhang, Yixuan, et al.
Published: (2025)

High Dimensional Bayesian Optimization using Lasso Variable Selection
by: Hoang, Vu Viet, et al.
Published: (2025)

A Model Selection Approach for Corruption Robust Reinforcement Learning
by: Wei, Chen-Yu, et al.
Published: (2021)

Transmuting prompts into weights
by: Mazzawi, Hanna, et al.
Published: (2025)

MuRating: A High Quality Data Selecting Approach to Multilingual Large Language Model Pretraining
by: Chen, Zhixun, et al.
Published: (2025)

Dynamical System Identification, Model Selection and Model Uncertainty Quantification by Bayesian Inference
by: Niven, Robert K., et al.
Published: (2024)