Imagen de Portada

Enabling Large Batch Size Training for DNN Models Beyond the Memory Limit While Maintaining Performance

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Piao, XinYu, Synn, DoangJoo, Park, JooYoung, Kim, Jong-Kook
Formato:	Preprint
Publicado:	2021
Materias:	Machine Learning Distributed, Parallel, and Cluster Computing
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Nexus: Transparent I/O Offloading for High-Density Serverless Computing
por: Park, JooYoung, et al.
Publicado: (2026)

HarmonyBatch: Batching multi-SLO DNN Inference with Heterogeneous Serverless Functions
por: Chen, Jiabin, et al.
Publicado: (2024)

Training DNN Models over Heterogeneous Clusters with Optimal Performance
por: Nie, Chengyi, et al.
Publicado: (2024)

Performance Characterization of Containerized DNN Training and Inference on Edge Accelerators
por: K., Prashanthi S., et al.
Publicado: (2023)

GMLake: Efficient and Transparent GPU Memory Defragmentation for Large-scale DNN Training with Virtual Memory Stitching
por: Guo, Cong, et al.
Publicado: (2024)

ParvaGPU: Efficient Spatial GPU Sharing for Large-Scale DNN Inference in Cloud Environments
por: Lee, Munkyu, et al.
Publicado: (2024)

COPUS: Co-adaptive Parallelism and Batch Size Selection in Large Language Model Training
por: Sakip, Akhmed, et al.
Publicado: (2026)

Memory Efficient and Staleness Free Pipeline Parallel DNN Training Framework with Improved Convergence Speed
por: Dutta, Ankita, et al.
Publicado: (2025)

TiMePReSt: Time and Memory Efficient Pipeline Parallel DNN Training with Removed Staleness
por: Dutta, Ankita, et al.
Publicado: (2024)

Fulcrum: Optimizing Concurrent DNN Training and Inferencing on Edge Accelerators
por: K., Prashanthi S., et al.
Publicado: (2025)

Parcae: Proactive, Liveput-Optimized DNN Training on Preemptible Instances
por: Duan, Jiangfei, et al.
Publicado: (2024)

SWIFT: Expedited Failure Recovery for Large-scale DNN Training
por: Zhong, Yuchen, et al.
Publicado: (2023)

Nezha: Breaking Multi-Rail Network Barriers for Distributed DNN Training
por: Yu, Enda, et al.
Publicado: (2024)

A Flexible Programmable Pipeline Parallelism Framework for Efficient DNN Training
por: Jiang, Lijuan, et al.
Publicado: (2025)

Poplar: Efficient Scaling of Distributed DNN Training on Heterogeneous GPU Clusters
por: Zhang, WenZheng, et al.
Publicado: (2024)

Symphony: Optimized DNN Model Serving using Deferred Batch Scheduling
por: Chen, Lequn, et al.
Publicado: (2023)

HAP: SPMD DNN Training on Heterogeneous GPU Clusters with Automated Program Synthesis
por: Zhang, Shiwei, et al.
Publicado: (2024)

GPU Memory and Utilization Estimation for Training-Aware Resource Management: Opportunities and Limitations
por: Yousefzadeh-Asl-Miandoab, Ehsan, et al.
Publicado: (2026)

Maxing Out the SVM: Performance Impact of Memory and Program Cache Sizes in the Agave Validator
por: Vural, Turan, et al.
Publicado: (2025)

Enabling Efficient Batch Serving for LMaaS via Generation Length Prediction
por: Cheng, Ke, et al.
Publicado: (2024)

On the Performance and Memory Footprint of Distributed Training: An Empirical Study on Transformers
por: Lu, Zhengxian, et al.
Publicado: (2024)

EaCO: Resource Sharing Dynamics and Its Impact on Energy Efficiency for DNN Training
por: Haghshenas, Kawsar, et al.
Publicado: (2024)

A Survey of End-to-End Modeling for Distributed DNN Training: Workloads, Simulators, and TCO
por: Svedas, Jonas, et al.
Publicado: (2025)

Optimizing LLM Inference Throughput via Memory-aware and SLA-constrained Dynamic Batching
por: Pang, Bowen, et al.
Publicado: (2025)

Boosting Performance of Iterative Applications on GPUs: Kernel Batching with CUDA Graphs
por: Ekelund, Jonah, et al.
Publicado: (2025)

Collaborative Batch Size Optimization for Federated Learning
por: Geimer, Arno, et al.
Publicado: (2025)

CodecSight: Leveraging Video Codec Signals for Efficient Streaming VLM Inference
por: Zou, Yulin, et al.
Publicado: (2026)

NestedFP: High-Performance, Memory-Efficient Dual-Precision Floating Point Support for LLMs
por: Lee, Haeun, et al.
Publicado: (2025)

GriNNder: Breaking the Memory Capacity Wall in Full-Graph GNN Training with Storage Offloading
por: Song, Jaeyong, et al.
Publicado: (2026)

PaSE: Parallelization Strategies for Efficient DNN Training
por: Elango, Venmugil
Publicado: (2024)

Practical Performance Guarantees for Pipelined DNN Inference
por: Archer, Aaron, et al.
Publicado: (2023)

On Optimal Batch Size in Coded Computing
por: Saha, Swapnil, et al.
Publicado: (2025)

EdgeServing: Deadline-Aware Multi-DNN Serving at the Edge
por: Cao, Jiahe, et al.
Publicado: (2026)

GraphPipe: Improving Performance and Scalability of DNN Training with Graph Pipeline Parallelism
por: Jeon, Byungsoo, et al.
Publicado: (2024)

Graph Neural Network Training Systems: A Performance Comparison of Full-Graph and Mini-Batch
por: Bajaj, Saurabh, et al.
Publicado: (2024)

Pagoda: An Energy and Time Roofline Study for DNN Workloads on Edge Accelerators
por: K., Prashanthi S., et al.
Publicado: (2025)

Collaborative Satellite Computing through Adaptive DNN Task Splitting and Offloading
por: Peng, Shifeng, et al.
Publicado: (2024)

Ocularone-Bench: Benchmarking DNN Models on GPUs to Assist the Visually Impaired
por: Raj, Suman, et al.
Publicado: (2025)

EcoFed: Efficient Communication for DNN Partitioning-based Federated Learning
por: Wu, Di, et al.
Publicado: (2023)

Online Optimization of DNN Inference Network Utility in Collaborative Edge Computing
por: Li, Rui, et al.
Publicado: (2024)