Image de couverture de livre

Checkmate: Zero-Overhead Model Checkpointing via Network Gradient Replication

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Bhardwaj, Ankit, Wang, Weiyang, Carin, Jeremy, Belay, Adam, Ghobadi, Manya
Format:	Preprint
Publié:	2025
Sujets:	Distributed, Parallel, and Cluster Computing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

KaMPIng: Flexible and (Near) Zero-Overhead C++ Bindings for MPI
par: Uhl, Tim Niklas, et autres
Publié: (2024)

Near-Zero-Overhead Freshness for Recommendation Systems via Inference-Side Model Updates
par: Yu, Wenjun, et autres
Publié: (2025)

Optimizing Frequent Checkpointing via Low-Cost Differential for Distributed Training Systems
par: Yao, Chenxuan, et autres
Publié: (2025)

Scaling LLM Inference Beyond Amdahl`s Limits via Eliminating Non-Scalable Overheads
par: Zhao, Alan, et autres
Publié: (2026)

MLTCP: Congestion Control for DNN Training
par: Rajasekaran, Sudarsanan, et autres
Publié: (2024)

Asynchronous Checkpoint for Eventually Consistent Databases
par: Ravishankar, Raaghav, et autres
Publié: (2025)

Building State Machine Replication Using Practical Network Synchrony
par: Wan, Yiliang, et autres
Publié: (2025)

AMSP: Reducing Communication Overhead of ZeRO for Efficient LLM Training
par: Chen, Qiaoling, et autres
Publié: (2023)

Parallelize Over Data Particle Advection: Participation, Ping Pong Particles, and Overhead
par: Wang, Zhe, et autres
Publié: (2024)

Understanding and Reducing Metadata-Driven Host Overheads in Sampling-Based GNN Training
par: Gong, Yidong, et autres
Publié: (2026)

Modular Architecture for High-Performance and Low Overhead Data Transfers
par: Swargo, Rasman Mubtasim, et autres
Publié: (2025)

CRIUgpu: Transparent Checkpointing of GPU-Accelerated Workloads
par: Stoyanov, Radostin, et autres
Publié: (2025)

Scrutinizing Variables for Checkpoint Using Automatic Differentiation
par: Huang, Xin, et autres
Publié: (2026)

Optimal Checkpoint Interval with Availability as an Objective Function
par: Saxena, Nirmal Raj, et autres
Publié: (2024)

Checkpoint and Restart: An Energy Consumption Characterization in Clusters
par: Moran, Marina, et autres
Publié: (2024)

Benchmarking Compound AI Applications for Hardware-Software Co-Design
par: Samuthrsindh, Paramuth, et autres
Publié: (2026)

LLMTailor: A Layer-wise Tailoring Tool for Efficient Checkpointing of Large Language Models
par: Sun, Minqiu, et autres
Publié: (2026)

Efficient LLM Inference with Activation Checkpointing and Hybrid Caching
par: Lee, Sanghyeon, et autres
Publié: (2025)

Sparse Checkpointing for Fast and Reliable MoE Training
par: Gandhi, Swapnil, et autres
Publié: (2024)

Understanding LLM Checkpoint/Restore I/O Strategies and Patterns
par: Gossman, Mikaila J., et autres
Publié: (2025)

CRIU -- Checkpoint Restore in Userspace for computational simulations and scientific applications
par: Andrijauskas, Fabio, et autres
Publié: (2024)

SafarDB: FPGA-Accelerated Distributed Transactions via Replicated Data Types
par: Saberlatibari, Javad, et autres
Publié: (2026)

FeedSign: Robust Full-parameter Federated Fine-tuning of Large Models with Extremely Low Communication Overhead of One Bit
par: Cai, Zhijie, et autres
Publié: (2025)

Reliable Replication Protocols on SmartNICs
par: Katebzadeh, M. R. Siavash, et autres
Publié: (2025)

Undo and Redo Support for Replicated Registers
par: Stewen, Leo, et autres
Publié: (2024)

Junctiond: Extending FaaS Runtimes with Kernel-Bypass
par: Saurez, Enrique, et autres
Publié: (2024)

A Lightweight Approach for State Machine Replication
par: Cachin, Christian, et autres
Publié: (2025)

Mangrove: Fast and Parallelizable State Replication for Blockchains
par: Paramonov, Anton, et autres
Publié: (2025)

Approaches to Conflict-free Replicated Data Types
par: Almeida, Paulo Sérgio
Publié: (2023)

Linearizability and State-Machine Replication: Is it a match?
par: Hauck, Franz J., et autres
Publié: (2024)

The Cost of Garbage Collection for State Machine Replication
par: Liang, Zhiying, et autres
Publié: (2024)

A Unified, Practical, and Understandable Model of Non-transactional Consistency Levels in Distributed Replication
par: Hu, Guanzhou, et autres
Publié: (2024)

Ocior: Ultra-Fast Asynchronous Leaderless Consensus with Two-Round Finality, Linear Overhead, and Adaptive Security
par: Chen, Jinyuan
Publié: (2025)

NAVIS: Concurrent Search and Update with Low Position-Seeking Overhead in On-SSD Graph-Based Vector Search
par: Song, Jaeyong, et autres
Publié: (2026)

Wait-free Replicated Data Types and Fair Reconciliation
par: Kuznetsov, Petr, et autres
Publié: (2025)

Resilience through Automated Adaptive Configuration for Distribution and Replication
par: Stoller, Scott D., et autres
Publié: (2025)

Vertical Atomic Broadcast and Passive Replication (Extended Version)
par: Bravo, Manuel, et autres
Publié: (2024)

SWARM: Replicating Shared Disaggregated-Memory Data in No Time
par: Murat, Antoine, et autres
Publié: (2024)

Orbax: Distributed Checkpointing with JAX
par: Gaffney, Colin, et autres
Publié: (2026)

Multi-Resolution Model Fusion for Accelerating the Convolutional Neural Network Training
par: Wang, Kewei, et autres
Publié: (2025)