Copertina

Unity is Power: Semi-Asynchronous Collaborative Training of Large-Scale Models with Structured Pruning in Resource-Limited Clients

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Li, Yan, Zhang, Xiao, Li, Mingyi, Xu, Guangwei, Chen, Feng, Yuan, Yuan, Zou, Yifei, Zhao, Mengying, Lu, Jianbo, Yu, Dongxiao
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Distributed, Parallel, and Cluster Computing Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Distributed Bilevel Optimization with Dual Pruning for Resource-limited Clients
di: Li, Mingyi, et al.
Pubblicazione: (2025)

LIME:Accelerating Collaborative Lossless LLM Inference on Memory-Constrained Edge Devices
di: Sun, Mingyu, et al.
Pubblicazione: (2025)

Bridging Memory Gaps: Scaling Federated Learning for Heterogeneous Clients
di: Wu, Yebo, et al.
Pubblicazione: (2024)

SAFL: Structure-Aware Personalized Federated Learning via Client-Specific Clustering and SCSI-Guided Model Pruning
di: Li, Nan, et al.
Pubblicazione: (2025)

Federated Semi-Supervised and Semi-Asynchronous Learning for Anomaly Detection in IoT Networks
di: Zhai, Wenbin, et al.
Pubblicazione: (2023)

Achieving Linear Speedup in Asynchronous Federated Learning with Heterogeneous Clients
di: Wang, Xiaolu, et al.
Pubblicazione: (2024)

PruneX: A Hierarchical Communication-Efficient System for Distributed CNN Training with Structured Pruning
di: Olama, Alireza, et al.
Pubblicazione: (2025)

An Experimental Study of Different Aggregation Schemes in Semi-Asynchronous Federated Learning
di: Li, Yunbo, et al.
Pubblicazione: (2024)

FedAdaVR: Adaptive Variance Reduction for Robust Federated Learning under Limited Client Participation
di: Howlader, S M Ruhul Kabir, et al.
Pubblicazione: (2026)

A Resource-Adaptive Approach for Federated Learning under Resource-Constrained Environments
di: Zhang, Ruirui, et al.
Pubblicazione: (2024)

EchoPFL: Asynchronous Personalized Federated Learning on Mobile Devices with On-Demand Staleness Control
di: Li, Xiaochen, et al.
Pubblicazione: (2024)

SEAFL: Enhancing Efficiency in Semi-Asynchronous Federated Learning through Adaptive Aggregation and Selective Training
di: Islam, Md Sirajul, et al.
Pubblicazione: (2025)

VDCores: Resource Decoupled Programming and Execution for Asynchronous GPU
di: He, Zijian, et al.
Pubblicazione: (2026)

COoL-TEE: Client-TEE Collaboration for Resilient Distributed Search
di: Bettinger, Matthieu, et al.
Pubblicazione: (2025)

Dynamic Client Clustering, Bandwidth Allocation, and Workload Optimization for Semi-synchronous Federated Learning
di: Yu, Liangkun, et al.
Pubblicazione: (2024)

Unleashing Efficient Asynchronous RL Post-Training via Staleness-Constrained Rollout Coordination
di: Li, Haoyang, et al.
Pubblicazione: (2026)

CSAFL: A Clustered Semi-Asynchronous Federated Learning Framework
di: Zhang, Yu, et al.
Pubblicazione: (2021)

GPU Memory and Utilization Estimation for Training-Aware Resource Management: Opportunities and Limitations
di: Yousefzadeh-Asl-Miandoab, Ehsan, et al.
Pubblicazione: (2026)

Collaborative Multi-Agent Reinforcement Learning Approach for Elastic Cloud Resource Scaling
di: Fang, Bruce, et al.
Pubblicazione: (2025)

Hyperion: Low-Latency Ultra-HD Video Analytics via Collaborative Vision Transformer Inference
di: Jiang, Linyi, et al.
Pubblicazione: (2025)

HexiScale: Facilitating Large Language Model Training over Heterogeneous Hardware
di: Yan, Ran, et al.
Pubblicazione: (2024)

Pollen: High-throughput Federated Learning Simulation via Resource-Aware Client Placement
di: Sani, Lorenzo, et al.
Pubblicazione: (2023)

Falcon: Advancing Asynchronous BFT Consensus for Lower Latency and Enhanced Throughput
di: Dai, Xiaohai, et al.
Pubblicazione: (2025)

CaPGNN: Optimizing Parallel Graph Neural Network Training with Joint Caching and Resource-Aware Graph Partitioning
di: Song, Xianfeng, et al.
Pubblicazione: (2025)

Many Hands Make Light Work: Accelerating Edge Inference via Multi-Client Collaborative Caching
di: Liang, Wenyi, et al.
Pubblicazione: (2024)

FedQS: Optimizing Gradient and Model Aggregation for Semi-Asynchronous Federated Learning
di: Li, Yunbo, et al.
Pubblicazione: (2025)

Collaborative Evolution of Intelligent Agents in Large-Scale Microservice Systems
di: Li, Yilin, et al.
Pubblicazione: (2025)

Amortized Asynchronous Byzantine Reliable Broadcast with Optimal Resilience
di: Hu, Michael Yiqing, et al.
Pubblicazione: (2026)

Lemonshark: Asynchronous DAG-BFT With Early Finality
di: Hu, Michael Yiqing, et al.
Pubblicazione: (2026)

Efficient CPU-GPU Collaborative Inference for MoE-based LLMs on Memory-Limited Systems
di: Huang, En-Ming, et al.
Pubblicazione: (2025)

Radiation Hydrodynamics at Scale: Comparing MPI and Asynchronous Many-Task Runtimes with FleCSI
di: Strack, Alexander, et al.
Pubblicazione: (2026)

Vortex: Overcoming Memory Capacity Limitations in GPU-Accelerated Large-Scale Data Analytics
di: Yuan, Yichao, et al.
Pubblicazione: (2025)

GAS: Generative Activation-Aided Asynchronous Split Federated Learning
di: Yang, Jiarong, et al.
Pubblicazione: (2024)

AMDP: Asynchronous Multi-Directional Pipeline Parallelism for Large-Scale Models Training
di: Chen, Ling, et al.
Pubblicazione: (2026)

Lagom: Unleashing the Power of Communication and Computation Overlapping for Distributed LLM Training
di: Xu, Guanbin, et al.
Pubblicazione: (2026)

Federated Fine-Tuning of Sparsely-Activated Large Language Models on Resource-Constrained Devices
di: Chen, Fahao, et al.
Pubblicazione: (2025)

AReaL-Hex: Accommodating Asynchronous RL Training over Heterogeneous GPUs
di: Yan, Ran, et al.
Pubblicazione: (2025)

FedAPTA: Federated Multi-task Learning for Heterogeneous Devices with Adaptive Layer-wise Pruning and Task-aware Aggregation
di: Yu, Zhen, et al.
Pubblicazione: (2025)

Memory-Efficient Federated Fine-Tuning of Large Language Models via Layer Pruning
di: Wu, Yebo, et al.
Pubblicazione: (2025)

Collaborative Inference and Learning between Edge SLMs and Cloud LLMs: A Survey of Algorithms, Execution, and Open Challenges
di: Li, Senyao, et al.
Pubblicazione: (2025)