Copertina

LLMTailor: A Layer-wise Tailoring Tool for Efficient Checkpointing of Large Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Sun, Minqiu, Huang, Xin, Guo, Luanzheng, Tallent, Nathan R., Sato, Kento, Dai, Dong
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Distributed, Parallel, and Cluster Computing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Scrutinizing Variables for Checkpoint Using Automatic Differentiation
di: Huang, Xin, et al.
Pubblicazione: (2026)

On The Reproducibility Limitations of RAG Systems
di: Wang, Baiqiang, et al.
Pubblicazione: (2025)

PowerTrip: Exploiting Federated Heterogeneous Datacenter Power for Distributed ML Training
di: Mehboob, Talha, et al.
Pubblicazione: (2025)

QoSFlow: Ensuring Service Quality of Distributed Workflows Using Interpretable Sensitivity Models
di: Rashid, Md Hasanur, et al.
Pubblicazione: (2026)

Distributed Order Recording Techniques for Efficient Record-and-Replay of Multi-threaded Programs
di: Fu, Xiang, et al.
Pubblicazione: (2026)

CARAT: Client-Side Adaptive RPC and Cache Co-Tuning for Parallel File Systems
di: Rashid, Md Hasanur, et al.
Pubblicazione: (2026)

ParaLog: Consistent Host-side Logging for Parallel Checkpoints
di: Chien, Steven W. D., et al.
Pubblicazione: (2024)

Memory-Efficient Federated Fine-Tuning of Large Language Models via Layer Pruning
di: Wu, Yebo, et al.
Pubblicazione: (2025)

MassiveGNN: Efficient Training via Prefetching for Massively Connected Distributed Graphs
di: Sarkar, Aishwarya, et al.
Pubblicazione: (2024)

Efficient LLM Inference with Activation Checkpointing and Hybrid Caching
di: Lee, Sanghyeon, et al.
Pubblicazione: (2025)

Overcoming Memory Constraints in Quantum Circuit Simulation with a High-Fidelity Compression Framework
di: Zhang, Boyuan, et al.
Pubblicazione: (2024)

Improving SpGEMM Performance Through Matrix Reordering and Cluster-wise Computation
di: Islam, Abdullah Al Raqibul, et al.
Pubblicazione: (2025)

Understanding Power Consumption Metric on Heterogeneous Memory Systems
di: Proaño, Andrès Rubio, et al.
Pubblicazione: (2024)

TierCheck: Tiered Checkpointing for Fault Tolerance in Large Language Model Training
di: Han, Shujie, et al.
Pubblicazione: (2026)

FedQuad: Adaptive Layer-wise LoRA Deployment and Activation Quantization for Federated Fine-Tuning
di: Li, Rukuo, et al.
Pubblicazione: (2025)

NOMAD: Generating Embeddings for Massive Distributed Graphs
di: Sarkar, Aishwarya, et al.
Pubblicazione: (2026)

InternEvo: Efficient Long-sequence Large Language Model Training via Hybrid Parallelism and Redundant Sharding
di: Chen, Qiaoling, et al.
Pubblicazione: (2024)

Efficient Training of Large Language Models on Distributed Infrastructures: A Survey
di: Duan, Jiangfei, et al.
Pubblicazione: (2024)

DataStates-LLM: Lazy Asynchronous Checkpointing for Large Language Models
di: Maurya, Avinash, et al.
Pubblicazione: (2024)

SLO-Aware Scheduling for Large Language Model Inferences
di: Huang, Jinqi, et al.
Pubblicazione: (2025)

DreamDDP: Accelerating Data Parallel Distributed LLM Training with Layer-wise Scheduled Partial Synchronization
di: Tang, Zhenheng, et al.
Pubblicazione: (2025)

Universal Checkpointing: A Flexible and Efficient Distributed Checkpointing System for Large-Scale DNN Training with Reconfigurable Parallelis
di: Lian, Xinyu, et al.
Pubblicazione: (2024)

Fault-Tolerant Hybrid-Parallel Training at Scale with Reliable and Efficient In-memory Checkpointing
di: Wang, Yuxin, et al.
Pubblicazione: (2023)

Asynchronous Checkpoint for Eventually Consistent Databases
di: Ravishankar, Raaghav, et al.
Pubblicazione: (2025)

Checkmate: Zero-Overhead Model Checkpointing via Network Gradient Replication
di: Bhardwaj, Ankit, et al.
Pubblicazione: (2025)

Mell: Memory-Efficient Large Language Model Serving via Multi-GPU KV Cache Management
di: Qianli, Liu, et al.
Pubblicazione: (2025)

Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training
di: Sun, Ao, et al.
Pubblicazione: (2024)

CRIUgpu: Transparent Checkpointing of GPU-Accelerated Workloads
di: Stoyanov, Radostin, et al.
Pubblicazione: (2025)

Optimal Checkpoint Interval with Availability as an Objective Function
di: Saxena, Nirmal Raj, et al.
Pubblicazione: (2024)

Checkpoint and Restart: An Energy Consumption Characterization in Clusters
di: Moran, Marina, et al.
Pubblicazione: (2024)

Cascadia: An Efficient Cascade Serving System for Large Language Models
di: Jiang, Youhe, et al.
Pubblicazione: (2025)

SeaLLM: Service-Aware and Latency-Optimized Resource Sharing for Large Language Model Inference
di: Zhao, Yihao, et al.
Pubblicazione: (2025)

DistTrain: Addressing Model and Data Heterogeneity with Disaggregated Training for Multimodal Large Language Models
di: Zhang, Zili, et al.
Pubblicazione: (2024)

Pier: Efficient Large Language Model pretraining with Relaxed Global Communication
di: Fan, Shuyuan, et al.
Pubblicazione: (2025)

Sparse Checkpointing for Fast and Reliable MoE Training
di: Gandhi, Swapnil, et al.
Pubblicazione: (2024)

FedAPTA: Federated Multi-task Learning for Heterogeneous Devices with Adaptive Layer-wise Pruning and Task-aware Aggregation
di: Yu, Zhen, et al.
Pubblicazione: (2025)

MoLink: Distributed and Efficient Serving Framework for Large Models
di: Jin, Lewei, et al.
Pubblicazione: (2025)

FLYING SERVING: On-the-Fly Parallelism Switching for Large Language Model Serving
di: Gao, Shouwei, et al.
Pubblicazione: (2026)

CRIU -- Checkpoint Restore in Userspace for computational simulations and scientific applications
di: Andrijauskas, Fabio, et al.
Pubblicazione: (2024)

Understanding LLM Checkpoint/Restore I/O Strategies and Patterns
di: Gossman, Mikaila J., et al.
Pubblicazione: (2025)