:: Library Catalog

Image de couverture de livre

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Liu, Mengfan, Zheng, Da, Su, Junwei, Wu, Chuan
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning
Accès en ligne:	https://arxiv.org/abs/2601.22678
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

AdaBatchGrad: Combining Adaptive Batch Size and Adaptive Step Size
par: Ostroukhov, Petr, et autres
Publié: (2024)

Graph Neural Network Training Systems: A Performance Comparison of Full-Graph and Mini-Batch
par: Bajaj, Saurabh, et autres
Publié: (2024)

Scaling Law for Language Models Training Considering Batch Size
par: Shuai, Xian, et autres
Publié: (2024)

Critical Batch Size Revisited: A Simple Empirical Approach to Large-Batch Language Model Training
par: Merrill, William, et autres
Publié: (2025)

Surge Phenomenon in Optimal Learning Rate and Batch Size Scaling
par: Li, Shuaipeng, et autres
Publié: (2024)

Seesaw: Accelerating Training by Balancing Learning Rate and Batch Size Scheduling
par: Meterez, Alexandru, et autres
Publié: (2025)

Convergence Bound and Critical Batch Size of Muon Optimizer
par: Sato, Naoki, et autres
Publié: (2025)

DYNAMITE: Dynamic Interplay of Mini-Batch Size and Aggregation Frequency for Federated Learning with Static and Streaming Dataset
par: Liu, Weijie, et autres
Publié: (2023)

BG-HGNN: Toward Efficient Learning for Complex Heterogeneous Graphs
par: Su, Junwei, et autres
Publié: (2024)

Collaborative Batch Size Optimization for Federated Learning
par: Geimer, Arno, et autres
Publié: (2025)

Adaptive Batch Size Schedules for Distributed Training of Language Models with Data and Model Parallelism
par: Lau, Tim Tsz-Kit, et autres
Publié: (2024)

Requests of a Feather Must Flock Together: Batch Size vs. Prefix Homogeneity in LLM Inference
par: Rathi, Saksham, et autres
Publié: (2026)

DIVEBATCH: Accelerating Model Training Through Gradient-Diversity Aware Batch Size Adaptation
par: Chen, Yuen, et autres
Publié: (2025)

On the Role of Batch Size in Stochastic Conditional Gradient Methods
par: Islamov, Rustem, et autres
Publié: (2026)

How Does Critical Batch Size Scale in Pre-training?
par: Zhang, Hanlin, et autres
Publié: (2024)

A Non-Asymptotic Convergent Analysis for Scored-Based Graph Generative Model via a System of Stochastic Differential Equations
par: Su, Junwei, et autres
Publié: (2025)

Smaller Batches, Bigger Gains? Investigating the Impact of Batch Sizes on Reinforcement Learning Based Real-World Production Scheduling
par: Müller, Arthur, et autres
Publié: (2024)

Beware of the Batch Size: Hyperparameter Bias in Evaluating LoRA
par: Lee, Sangyoon, et autres
Publié: (2026)

Efficient GNN Training Through Structure-Aware Randomized Mini-Batching
par: Balaji, Vignesh, et autres
Publié: (2025)

On the Interplay between Graph Structure and Learning Algorithms in Graph Neural Networks
par: Su, Junwei, et autres
Publié: (2025)

Increasing Batch Size Improves Convergence of Stochastic Gradient Descent with Momentum
par: Kamo, Keisuke, et autres
Publié: (2025)

Mini-Batch Kernel $k$-means
par: Jourdan, Ben, et autres
Publié: (2024)

Adaptive Batch Size for Privately Finding Second-Order Stationary Points
par: Liu, Daogao, et autres
Publié: (2024)

AdAdaGrad: Adaptive Batch Size Schemes for Adaptive Gradient Methods
par: Lau, Tim Tsz-Kit, et autres
Publié: (2024)

Debiasing Mini-Batch Quadratics for Applications in Deep Learning
par: Tatzel, Lukas, et autres
Publié: (2024)

Accelerating SGDM via Learning Rate and Batch Size Schedules: A Lyapunov-Based Analysis
par: Kondo, Yuichi, et autres
Publié: (2025)

Communication-Efficient Adaptive Batch Size Strategies for Distributed Local Gradient Methods
par: Lau, Tim Tsz-Kit, et autres
Publié: (2024)

On the Topology Awareness and Generalization Performance of Graph Neural Networks
par: Su, Junwei, et autres
Publié: (2024)

Faster Convergence of Riemannian Stochastic Gradient Descent with Increasing Batch Size
par: Oowada, Kanata, et autres
Publié: (2025)

Small Batch Size Training for Language Models: When Vanilla SGD Works, and Why Gradient Accumulation Is Wasteful
par: Marek, Martin, et autres
Publié: (2025)

Mini-Batch Class Composition Bias in Link Prediction
par: Maguire, Kieran, et autres
Publié: (2026)

The Effect of Batch Size on Contrastive Self-Supervised Speech Representation Learning
par: Vaessen, Nik, et autres
Publié: (2024)

Perfect Parallelization in Mini-Batch SGD with Classical Momentum Acceleration
par: Garg, Sachin, et autres
Publié: (2026)

Increasing Both Batch Size and Learning Rate Accelerates Stochastic Gradient Descent
par: Umeda, Hikaru, et autres
Publié: (2024)

Time Transfer: On Optimal Learning Rate and Batch Size In The Infinite Data Limit
par: Filatov, Oleg, et autres
Publié: (2024)

Optimal Batch-Size Control for Low-Latency Federated Learning with Device Heterogeneity
par: Yang, Huiling, et autres
Publié: (2025)

Enabling Large Batch Size Training for DNN Models Beyond the Memory Limit While Maintaining Performance
par: Piao, XinYu, et autres
Publié: (2021)

Scalable Graph Attention-based Instance Selection via Mini-Batch Sampling and Hierarchical Hashing
par: Rustamov, Zahiriddin, et autres
Publié: (2025)

Hierarchical Rectified Flow Matching with Mini-Batch Couplings
par: Zhang, Yichi, et autres
Publié: (2025)

One Size Does Not Fit All: Architecture-Aware Adaptive Batch Scheduling with DEBA
par: Belias, François, et autres
Publié: (2025)