Copertina

FALCON: Pinpointing and Mitigating Stragglers for Large-Scale Hybrid-Parallel Training

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wu, Tianyuan, Wang, Wei, Yu, Yinghao, Yang, Siran, Wu, Wenchao, Duan, Qinkai, Yang, Guodong, Wang, Jiamang, Qu, Lin, Zhang, Liping
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Distributed, Parallel, and Cluster Computing Operating Systems
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Adaptra: Straggler-Resilient Hybrid-Parallel Training with Pipeline Adaptation
di: Wu, Tianyuan, et al.
Pubblicazione: (2025)

RollMux: Phase-Level Multiplexing for Disaggregated RL Post-Training
di: Wu, Tianyuan, et al.
Pubblicazione: (2025)

HybridTier: an Adaptive and Lightweight CXL-Memory Tiering System
di: Song, Kevin, et al.
Pubblicazione: (2023)

Formal Definitions and Performance Comparison of Consistency Models for Parallel File Systems
di: Wang, Chen, et al.
Pubblicazione: (2024)

RollPacker: Mitigating Long-Tail Rollouts for Fast, Synchronous RL Post-Training
di: Gao, Wei, et al.
Pubblicazione: (2025)

Malleus: Straggler-Resilient Hybrid Parallel Training of Large-scale Models via Malleable Data and Model Parallelization
di: Li, Haoyang, et al.
Pubblicazione: (2024)

ContiguousKV: Accelerating LLM Prefill with Granularity-Aligned KV Cache Management
di: Zou, Jing, et al.
Pubblicazione: (2026)

Mitigating context switching in densely packed Linux clusters with Latency-Aware Group Scheduling
di: Isstaif, Al Amjad Tawfiq, et al.
Pubblicazione: (2025)

BLITZSCALE: Fast and Live Large Model Autoscaling with O(1) Host Caching
di: Zhang, Dingyan, et al.
Pubblicazione: (2024)

Toward Systems Foundations for Agentic Exploration
di: Xu, Jiakai, et al.
Pubblicazione: (2025)

Equilibria: Fair Multi-Tenant CXL Memory Tiering At Scale
di: Zhao, Kaiyang, et al.
Pubblicazione: (2026)

Performance Isolation and Semantic Determinism in Efficient GPU Spatial Sharing
di: Yang, Zhenyuan, et al.
Pubblicazione: (2026)

Mitigating GIL Bottlenecks in Edge AI Systems
di: Mandal, Mridankan, et al.
Pubblicazione: (2026)

Fork, Explore, Commit: OS Primitives for Agentic Exploration
di: Wang, Cong, et al.
Pubblicazione: (2026)

GPUOS: A GPU Operating System Primitive for Transparent Operation Fusion
di: Yang, Yiwei, et al.
Pubblicazione: (2026)

DPC: A Distributed Page Cache over CXL
di: Bergman, Shai, et al.
Pubblicazione: (2026)

Agent Centric Operating System -- a Comprehensive Review and Outlook for Operating System
di: Jia, Shian, et al.
Pubblicazione: (2024)

Towards Efficient and Practical GPU Multitasking in the Era of LLM
di: Xing, Jiarong, et al.
Pubblicazione: (2025)

"Range as a Key" is the Key! Fast and Compact Cloud Block Store Index with RASK
di: Zhao, Haoru, et al.
Pubblicazione: (2026)

Nixie: Efficient, Transparent Temporal Multiplexing for Consumer GPUs
di: Xu, Yechen, et al.
Pubblicazione: (2026)

TIDAL: Recovering Temporal Phase for Cloud Block Storage Placement from LLM-Derived Semantics
di: Tan, Difan, et al.
Pubblicazione: (2026)

ROSE: Rollout On Serving GPUs via Cooperative Elasticity for Agentic RL
di: Gao, Wei, et al.
Pubblicazione: (2026)

TrEnv-X: Transparently Share Serverless Execution Environments Across Different Functions and Nodes
di: Huang, Jialiang, et al.
Pubblicazione: (2025)

EROICA: Online Performance Troubleshooting for Large-scale Model Training
di: Guan, Yu, et al.
Pubblicazione: (2025)

Fault-Tolerant Hybrid-Parallel Training at Scale with Reliable and Efficient In-memory Checkpointing
di: Wang, Yuxin, et al.
Pubblicazione: (2023)

EdgeFlow: Fast Cold Starts for LLMs on Mobile Devices
di: Yan, Yongsheng, et al.
Pubblicazione: (2026)

Unlocking True Elasticity for the Cloud-Native Era with Dandelion
di: Kuchler, Tom, et al.
Pubblicazione: (2025)

A Periodic Space of Distributed Computing: Vision & Framework
di: Salehi, Mohsen Amini, et al.
Pubblicazione: (2026)

THEMIS: Time, Heterogeneity, and Energy Minded Scheduling for Fair Multi-Tenant Use in FPGAs
di: Karabulut, Emre, et al.
Pubblicazione: (2024)

Mewz: Lightweight Execution Environment for WebAssembly with High Isolation and Portability using Unikernels
di: Ueda, Soichiro, et al.
Pubblicazione: (2024)

Taming Serverless Cold Starts Through OS Co-Design
di: Holmes, Ben, et al.
Pubblicazione: (2025)

Fix: externalizing network I/O in serverless computing
di: Deng, Yuhan, et al.
Pubblicazione: (2025)

RAGDoll: Efficient Offloading-based Online RAG System on a Single GPU
di: Yu, Weiping, et al.
Pubblicazione: (2025)

Optimizing Task Scheduling in Heterogeneous Computing Environments: A Comparative Analysis of CPU, GPU, and ASIC Platforms Using E2C Simulator
di: Mohammadjafari, Ali, et al.
Pubblicazione: (2024)

Telepathic Datacenters: Fast RPCs using Shared CXL Memory
di: Mahar, Suyash, et al.
Pubblicazione: (2024)

CvxCluster: Solving Large, Complex, Granular Resource Allocation Problems 100-1000x Faster
di: Nnorom Jr, Obi, et al.
Pubblicazione: (2026)

LEFT-RS: A Lock-Free Fault-Tolerant Resource Sharing Protocol for Multicore Real-Time Systems
di: Chen, Nan, et al.
Pubblicazione: (2025)

Funky: Cloud-Native FPGA Virtualization and Orchestration
di: Koshiba, Atsushi, et al.
Pubblicazione: (2025)

Ensuring Data Freshness in Multi-Rate Task Chains Scheduling
di: Hoffmann, José Luis Conradi, et al.
Pubblicazione: (2026)

Rethinking Inter-Process Communication with Memory Operation Offloading
di: Park, Misun, et al.
Pubblicazione: (2026)