Adaptive Swin Transformer Partitioning over AI-RAN Networks

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Nguyen, Tam Thanh, Pua, Yong Hao, Van Ngo, Tuan, Ngo, Mao V., Park, Jihong, Chen, Binbin, Quek, Tony Q. S.
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915959076290560
author Nguyen, Tam Thanh
Pua, Yong Hao
Van Ngo, Tuan
Ngo, Mao V.
Park, Jihong
Chen, Binbin
Quek, Tony Q. S.
author_facet Nguyen, Tam Thanh
Pua, Yong Hao
Van Ngo, Tuan
Ngo, Mao V.
Park, Jihong
Chen, Binbin
Quek, Tony Q. S.
contents This paper demonstrates the feasibility of transformer-based split inference for real-time video object detection over dynamic 5G AI-RAN networks. We extend throughput-aware adaptive splitting from CNNs to a Swin Transformer backbone and show that practical split execution is achievable for transformer-based vision models without retraining. To address the large intermediate activations inherent to transformers, we introduce an efficient, accuracy-preserving activation compression pipeline that substantially reduces uplink payload. The complete system -- including adaptive split selection, transformer inference, and compression -- is implemented and validated end-to-end on a real-time detection workload, with distributed UPF (dUPF) integration further reducing user-plane latency and improving runtime stability. Extensive measurements on an NVIDIA Aerial-based AI-RAN testbed jointly account for inference and 5G communication energy, quantifying the latency-energy-privacy trade-offs in realistic deployments.
format Preprint
id arxiv_https___arxiv_org_abs_2604_23554
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Adaptive Swin Transformer Partitioning over AI-RAN Networks
Nguyen, Tam Thanh
Pua, Yong Hao
Van Ngo, Tuan
Ngo, Mao V.
Park, Jihong
Chen, Binbin
Quek, Tony Q. S.
Networking and Internet Architecture
This paper demonstrates the feasibility of transformer-based split inference for real-time video object detection over dynamic 5G AI-RAN networks. We extend throughput-aware adaptive splitting from CNNs to a Swin Transformer backbone and show that practical split execution is achievable for transformer-based vision models without retraining. To address the large intermediate activations inherent to transformers, we introduce an efficient, accuracy-preserving activation compression pipeline that substantially reduces uplink payload. The complete system -- including adaptive split selection, transformer inference, and compression -- is implemented and validated end-to-end on a real-time detection workload, with distributed UPF (dUPF) integration further reducing user-plane latency and improving runtime stability. Extensive measurements on an NVIDIA Aerial-based AI-RAN testbed jointly account for inference and 5G communication energy, quantifying the latency-energy-privacy trade-offs in realistic deployments.
title Adaptive Swin Transformer Partitioning over AI-RAN Networks
topic Networking and Internet Architecture
url https://arxiv.org/abs/2604.23554