Copertina

DeepCompile: A Compiler-Driven Approach to Optimizing Distributed Deep Learning Training

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Tanaka, Masahiro, Li, Du, Chand, Umesh, Zafar, Ali, Shen, Haiying, Ruwase, Olatunji
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Distributed, Parallel, and Cluster Computing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

AutoSP: Unlocking Long-Context LLM Training Via Compiler-Based Sequence Parallelism
di: Gupta, Ahan, et al.
Pubblicazione: (2026)

SuperOffload: Unleashing the Power of Large-Scale LLM Training on Superchips
di: Lian, Xinyu, et al.
Pubblicazione: (2025)

Universal Checkpointing: A Flexible and Efficient Distributed Checkpointing System for Large-Scale DNN Training with Reconfigurable Parallelis
di: Lian, Xinyu, et al.
Pubblicazione: (2024)

Training Ultra Long Context Language Model with Fully Pipelined Distributed Transformer
di: Yao, Jinghan, et al.
Pubblicazione: (2024)

FastPersist: Accelerating Model Checkpointing in Deep Learning
di: Wang, Guanhua, et al.
Pubblicazione: (2024)

Gensor: A Graph-based Construction Tensor Compilation Method for Deep Learning
di: Liu, Hangda, et al.
Pubblicazione: (2025)

Domino: Eliminating Communication in LLM Training via Generic Tensor Slicing and Overlapping
di: Wang, Guanhua, et al.
Pubblicazione: (2024)

Cross-Layer Energy Analysis of Multimodal Training on Grace Hopper Superchips
di: Ahmed, Mahmoud, et al.
Pubblicazione: (2026)

Flint: Compiler Enabled Cluster-Free Design Space Exploration for Distributed ML
di: Yoo, Jinsun, et al.
Pubblicazione: (2026)

Straggler Tolerant and Resilient DL Training on Homogeneous GPUs
di: Zhang, Zeyu, et al.
Pubblicazione: (2025)

Triton-distributed: Programming Overlapping Kernels on Distributed AI Systems with the Triton Compiler
di: Zheng, Size, et al.
Pubblicazione: (2025)

Optimizing Compilation for Distributed Quantum Computing via Clustering and Annealing
di: Zhou, Ruilin, et al.
Pubblicazione: (2025)

HPCTransCompile: An AI Compiler Generated Dataset for High-Performance CUDA Transpilation and LLM Preliminary Exploration
di: Lv, Jiaqi, et al.
Pubblicazione: (2025)

Efficient Parallel Compilation and Profiling of Quantum Circuits at Large Scales
di: Moore, Jane, et al.
Pubblicazione: (2026)

LAPIS: A Performance Portable, High Productivity Compiler Framework
di: Kelley, Brian, et al.
Pubblicazione: (2025)

EconoServe: Maximizing Multi-Resource Utilization with SLO Guarantees in LLM Serving
di: Shen, Haiying, et al.
Pubblicazione: (2024)

Optimizing High-Throughput Distributed Data Pipelines for Reproducible Deep Learning at Scale
di: Mittal, Kashish, et al.
Pubblicazione: (2026)

Optimizing Distributed Training Approaches for Scaling Neural Networks
di: Baligodugula, Vishnu Vardhan, et al.
Pubblicazione: (2025)

ECDQC: Efficient Compilation for Distributed Quantum Computing with Linear Layout
di: Liu, Kecheng, et al.
Pubblicazione: (2024)

Efficient Gate Reordering for Distributed Quantum Compiling in Data Centers
di: Mengoni, Riccardo, et al.
Pubblicazione: (2025)

Zen-Attention: A Compiler Framework for Dynamic Attention Folding on AMD NPUs
di: Deshmukh, Aadesh, et al.
Pubblicazione: (2025)

A Deep Reinforcement Learning Approach for Cost Optimized Workflow Scheduling in Cloud Computing Environments
di: Jayanetti, Amanda, et al.
Pubblicazione: (2024)

ScanWeaver: Compiler-Driven Parallelization of Affine Recurrences via Associative Scan Lowering
di: Wu, Qiying, et al.
Pubblicazione: (2026)

ELK: Exploring the Efficiency of Inter-core Connected AI Chips with Deep Learning Compiler Techniques
di: Liu, Yiqi, et al.
Pubblicazione: (2025)

Comparison of Vectorization Capabilities of Different Compilers for X86 and ARM CPUs
di: Sakib, Nazmus, et al.
Pubblicazione: (2025)

Edge Intelligence-Driven LegalEdge Contracts for EV Charging Stations: A Fedrated Learning with Deep Q-Networks Approach
di: Rahmani, Rahim, et al.
Pubblicazione: (2026)

Characterizing the Performance of Accelerated Jetson Edge Devices for Training Deep Learning Models
di: K., Prashanthi S., et al.
Pubblicazione: (2025)

LOOPer: A Learned Automatic Code Optimizer For Polyhedral Compilers
di: Merouani, Massinissa, et al.
Pubblicazione: (2024)

MalleTrain: Deep Neural Network Training on Unfillable Supercomputer Nodes
di: Ma, Xiaolong, et al.
Pubblicazione: (2024)

Workload-Aware Hardware Accelerator Mining for Distributed Deep Learning Training
di: Adnan, Muhammad, et al.
Pubblicazione: (2024)

SparDL: Distributed Deep Learning Training with Efficient Sparse Communication
di: Zhao, Minjun, et al.
Pubblicazione: (2023)

Leveraging Neural Graph Compilers in Machine Learning Research for Edge-Cloud Systems
di: Furutanpey, Alireza, et al.
Pubblicazione: (2025)

A Reinforcement Learning Environment for Automatic Code Optimization in the MLIR Compiler
di: Tirichine, Mohammed, et al.
Pubblicazione: (2024)

Resource-Efficient Compilation of Distributed Quantum Circuits for Solving Large-Scale Wireless Communication Network Problems
di: Chen, Kuan-Cheng, et al.
Pubblicazione: (2025)

Characterizing Compute-Communication Overlap in GPU-Accelerated Distributed Deep Learning: Performance and Power Implications
di: Lee, Seonho, et al.
Pubblicazione: (2025)

Communication-Efficient Distributed Training for Collaborative Flat Optima Recovery in Deep Learning
di: Dimlioglu, Tolga, et al.
Pubblicazione: (2025)

Optimizing Frequent Checkpointing via Low-Cost Differential for Distributed Training Systems
di: Yao, Chenxuan, et al.
Pubblicazione: (2025)

ZenFlow: Enabling Stall-Free Offloading Training via Asynchronous Updates
di: Lan, Tingfeng, et al.
Pubblicazione: (2025)

PacTrain: Pruning and Adaptive Sparse Gradient Compression for Efficient Collective Communication in Distributed Deep Learning
di: Wang, Yisu, et al.
Pubblicazione: (2025)

Maya: Optimizing Deep Learning Training Workloads using GPU Runtime Emulation
di: Yarlagadda, Srihas, et al.
Pubblicazione: (2025)