Communication-Computation Pipeline Parallel Split Learning over Wireless Edge Networks

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Chenyu, Zhang, Zhaoyang, Chen, Zirui, Yang, Zhaohui
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915643315453952
author Liu, Chenyu
Zhang, Zhaoyang
Chen, Zirui
Yang, Zhaohui
author_facet Liu, Chenyu
Zhang, Zhaoyang
Chen, Zirui
Yang, Zhaohui
contents Split learning (SL) offloads main computing tasks from multiple resource-constrained user equippments (UEs) to the base station (BS), while preserving local data privacy. However, its computation and communication processes remain sequential, resulting in limited system efficiency. To overcome this limitation, this paper applies pipeline parallelism (PP) of distributed training to SL in wireless networks, proposing the so-called communication-computation pipeline parallel split learning (C$^2$P$^2$SL). By considering the communicating and computing processes of UEs and BS as an overall pipeline, C$^2$P$^2$SL achieves pipeline parallelization among different micro-batches which are split from each batch of data samples. The overlap of communication and computation in this way significantly reduces the total training time. Given that training efficiency is affected by position of cutting layer and heterogeneity of the UEs, we formulate a joint optimization problem of task split and resource allocation, and design a solution based on alternating optimization. Experimental results demonstrate that C$^2$P$^2$SL significantly reduces system training time by over 38\% while maintaining convergence accuracy under different communication conditions.
format Preprint
id arxiv_https___arxiv_org_abs_2511_23167
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Communication-Computation Pipeline Parallel Split Learning over Wireless Edge Networks
Liu, Chenyu
Zhang, Zhaoyang
Chen, Zirui
Yang, Zhaohui
Distributed, Parallel, and Cluster Computing
Split learning (SL) offloads main computing tasks from multiple resource-constrained user equippments (UEs) to the base station (BS), while preserving local data privacy. However, its computation and communication processes remain sequential, resulting in limited system efficiency. To overcome this limitation, this paper applies pipeline parallelism (PP) of distributed training to SL in wireless networks, proposing the so-called communication-computation pipeline parallel split learning (C$^2$P$^2$SL). By considering the communicating and computing processes of UEs and BS as an overall pipeline, C$^2$P$^2$SL achieves pipeline parallelization among different micro-batches which are split from each batch of data samples. The overlap of communication and computation in this way significantly reduces the total training time. Given that training efficiency is affected by position of cutting layer and heterogeneity of the UEs, we formulate a joint optimization problem of task split and resource allocation, and design a solution based on alternating optimization. Experimental results demonstrate that C$^2$P$^2$SL significantly reduces system training time by over 38\% while maintaining convergence accuracy under different communication conditions.
title Communication-Computation Pipeline Parallel Split Learning over Wireless Edge Networks
topic Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2511.23167