Copertina

SENTINEL: Stagewise Integrity Verification for Pipeline Parallel Decentralized Training

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Dolatabadi, Hadi Mohaghegh, Ajanthan, Thalaiyasingam, Ramasinghe, Sameera, Koneputugodage, Chamin P Hewa, Avraham, Gil, Zuo, Yan, Shevchenko, Violetta, Long, Alexander
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Distributed, Parallel, and Cluster Computing Cryptography and Security Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

AsyncMesh: Fully Asynchronous Optimization for Data and Pipeline Parallelism
di: Ajanthan, Thalaiyasingam, et al.
Pubblicazione: (2026)

Nesterov Method for Asynchronous Pipeline Parallel Optimization
di: Ajanthan, Thalaiyasingam, et al.
Pubblicazione: (2025)

NuMuon: Nuclear-Norm-Constrained Muon for Compressible LLM Training
di: Dolatabadi, Hadi Mohaghegh, et al.
Pubblicazione: (2026)

Protocol Models: Scaling Decentralized Training with Communication-Efficient Model Parallelism
di: Ramasinghe, Sameera, et al.
Pubblicazione: (2025)

Neural Experts: Mixture of Experts for Implicit Neural Representations
di: Ben-Shabat, Yizhak, et al.
Pubblicazione: (2024)

VI3NR: Variance Informed Initialization for Implicit Neural Representations
di: Koneputugodage, Chamin Hewa, et al.
Pubblicazione: (2025)

Adaptra: Straggler-Resilient Hybrid-Parallel Training with Pipeline Adaptation
di: Wu, Tianyuan, et al.
Pubblicazione: (2025)

Balancing Pipeline Parallelism with Vocabulary Parallelism
di: Yeung, Man Tsung, et al.
Pubblicazione: (2024)

A Flexible Programmable Pipeline Parallelism Framework for Efficient DNN Training
di: Jiang, Lijuan, et al.
Pubblicazione: (2025)

DawnPiper: A Memory-scablable Pipeline Parallel Training Framework
di: Peng, Xuan, et al.
Pubblicazione: (2025)

JanusPipe: Efficient Pipeline Parallel Training for Machine Learning Interatomic Potentials
di: Wang, Hongyu, et al.
Pubblicazione: (2026)

Synergistic Tensor and Pipeline Parallelism
di: Qi, Mengshi, et al.
Pubblicazione: (2025)

Bandwidth-Aware and Cost-Efficient Pipeline Parallel Scheduling in Geo-Distributed LLM Training
di: Zhang, Han, et al.
Pubblicazione: (2026)

SPPO:Efficient Long-sequence LLM Training via Adaptive Sequence Pipeline Parallel Offloading
di: Chen, Qiaoling, et al.
Pubblicazione: (2025)

Enhancing Memory Efficiency in Large Language Model Training Through Chronos-aware Pipeline Parallelism
di: Lin, Xinyuan, et al.
Pubblicazione: (2025)

Memory Efficient and Staleness Free Pipeline Parallel DNN Training Framework with Improved Convergence Speed
di: Dutta, Ankita, et al.
Pubblicazione: (2025)

TiMePReSt: Time and Memory Efficient Pipeline Parallel DNN Training with Removed Staleness
di: Dutta, Ankita, et al.
Pubblicazione: (2024)

Lightweight Tamper-Evident Log Integrity Verification for IoT Edge Environments: A Merkle Tree Pipeline with Adaptive Chunking
di: Yagiz, Muhammet Anil, et al.
Pubblicazione: (2026)

TimelyFreeze: Adaptive Parameter Freezing Mechanism for Pipeline Parallelism
di: Cho, Seonghye, et al.
Pubblicazione: (2026)

HelixPipe: Efficient Distributed Training of Long Sequence Transformers with Attention Parallel Pipeline Parallelism
di: Zhang, Geng, et al.
Pubblicazione: (2025)

Seq1F1B: Efficient Sequence-Level Pipeline Parallelism for Large Language Model Training
di: Sun, Ao, et al.
Pubblicazione: (2024)

AMDP: Asynchronous Multi-Directional Pipeline Parallelism for Large-Scale Models Training
di: Chen, Ling, et al.
Pubblicazione: (2026)

A Readiness-Driven Runtime for Pipeline-Parallel Training under Runtime Variability
di: Liu, Ruitao, et al.
Pubblicazione: (2026)

Parallelizing Drug Discovery: HPC Pipelines for Alzheimer's Molecular Docking and Simulation
di: Alliata, Paul Ruiz, et al.
Pubblicazione: (2025)

Towards Efficient Verification of Parallel Applications with Mc SimGrid
di: Laurent, Matthieu, et al.
Pubblicazione: (2025)

Scaling Deep Learning Training with MPMD Pipeline Parallelism
di: Xhebraj, Anxhelo, et al.
Pubblicazione: (2024)

Scaling Prompt Instructed Zero Shot Composed Image Retrieval with Image-Only Data
di: Duan, Yiqun, et al.
Pubblicazione: (2025)

A Tabular Schedule Abstraction for Communication-Aware Evaluation of Pipeline-Parallel LLM Training
di: Barley, Daniel, et al.
Pubblicazione: (2026)

Heimdall++: Optimizing GPU Utilization and Pipeline Parallelism for Efficient Single-Pulse Detection
di: Xia, Bingzheng, et al.
Pubblicazione: (2025)

Accelerating Microswimmer Simulations via a Heterogeneous Pipelined Parallel-in-Time Framework
di: Huang, Ruixiang, et al.
Pubblicazione: (2026)

Communication-Computation Pipeline Parallel Split Learning over Wireless Edge Networks
di: Liu, Chenyu, et al.
Pubblicazione: (2025)

InfiniPipe: Elastic Pipeline Parallelism for Efficient Variable-Length Long-Context LLM Training
di: Wang, Shiju, et al.
Pubblicazione: (2025)

Incentive-Based Federated Learning: Architectural Elements and Future Directions
di: Kaluannakkage, Chanuka A. S. Hewa, et al.
Pubblicazione: (2025)

TD-Pipe: Temporally-Disaggregated Pipeline Parallelism Architecture for High-Throughput LLM Inference
di: Zhang, Hongbin, et al.
Pubblicazione: (2025)

AdaPtis: Reducing Pipeline Bubbles with Adaptive Pipeline Parallelism on Heterogeneous Models
di: Guo, Jihu, et al.
Pubblicazione: (2025)

FreeRide: Harvesting Bubbles in Pipeline Parallelism
di: Zhang, Jiashu, et al.
Pubblicazione: (2024)

SiPipe: Bridging the CPU-GPU Utilization Gap for Efficient Pipeline-Parallel LLM Inference
di: He, Yongchao, et al.
Pubblicazione: (2025)

gLLM: Global Balanced Pipeline Parallelism System for Distributed LLM Serving with Token Throttling
di: Guo, Tianyu, et al.
Pubblicazione: (2025)

Administrative Decentralization in Edge-Cloud Multi-Agent for Mobile Automation
di: Li, Senyao, et al.
Pubblicazione: (2026)

OptPipe: Memory- and Scheduling-Optimized Pipeline Parallelism for LLM Training
di: Li, Hongpei, et al.
Pubblicazione: (2025)