Cover Image

Going Beyond the Edge: Distributed Inference of Transformer Models on Ultra-Low-Power Wireless Devices

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Gräfe, Alexander, Huo, Ding, de Bakker, Vincent, Berger, Johannes, Zimmerling, Marco, Trimpe, Sebastian
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

RockNet: Distributed Learning on Ultra-Low-Power Devices
by: Gräfe, Alexander, et al.
Published: (2025)

DMPC-Swarm: Distributed Model Predictive Control on Nano UAV Swarms
by: Gräfe, Alexander, et al.
Published: (2025)

Event-triggered Robust Model Predictive Control under Hard Computation Resource Constraints
by: Gräfe, Alexander, et al.
Published: (2025)

Control-guided Communication: Efficient Resource Arbitration and Allocation in Multi-hop Wireless Control Systems
by: Baumann, Dominik, et al.
Published: (2019)

MPX: Mixed Precision Training for JAX
by: Gräfe, Alexander, et al.
Published: (2025)

Parameter-Adaptive Approximate MPC: Tuning Neural-Network Controllers without Retraining
by: Hose, Henrik, et al.
Published: (2024)

How to Model Your Crazyflie Brushless
by: Gräfe, Alexander, et al.
Published: (2026)

Ultra-Low-Latency Edge Inference for Distributed Sensing
by: Wang, Zhanwei, et al.
Published: (2024)

Neuromorphic Wireless Device-Edge Co-Inference via the Directed Information Bottleneck
by: Ke, Yuzhen, et al.
Published: (2024)

Efficient Partitioning Vision Transformer on Edge Devices for Distributed Inference
by: Liu, Xiang, et al.
Published: (2024)

EdgeFlex-Transformer: Transformer Inference for Edge Devices
by: Mohammad, Shoaib, et al.
Published: (2025)

Fine-Tuning of Neural Network Approximate MPC without Retraining via Bayesian Optimization
by: Hose, Henrik, et al.
Published: (2025)

An Ultra-Low-Power Synthesizable Asynchronous AER Encoder for Neuromorphic Edge Devices
by: Wang, Yihui, et al.
Published: (2026)

WISV: Wireless-Informed Semantic Verification for Distributed Speculative Decoding in Device-Edge LLM Inference
by: Liu, Zixuan, et al.
Published: (2026)

Biased Dreams: Limitations to Epistemic Uncertainty Quantification in Latent Space Models
by: Berger, Julia, et al.
Published: (2026)

Exact Inference for Continuous-Time Gaussian Process Dynamics
by: Ensinger, Katharina, et al.
Published: (2023)

Accelerated Training on Low-Power Edge Devices
by: Ahmed, Mohamed Aboelenien, et al.
Published: (2025)

Algunas observaciones sobre la parte sumergida del iceberg, o: Javier Muguerza, perplejo ante la racionalidad
by: Ruth Zimmerling
Published: (2000)

Los derechos humanos en un mundo globalizado y unipolar. Contra la devaluación conceptual y el cinismo práctico
by: Ruth Zimmerling
Published: (2004)

Vec-LUT: Vector Table Lookup for Parallel Ultra-Low-Bit LLM Inference on Edge Devices
by: Li, Xiangyu, et al.
Published: (2025)

Distributed Event-Based Learning via ADMM
by: Er, Guner Dilsad, et al.
Published: (2024)

Learning Hybrid Dynamics Models With Simulator-Informed Latent States
by: Ensinger, Katharina, et al.
Published: (2023)

Failure-Resilient Distributed Inference with Model Compression over Heterogeneous Edge Devices
by: Wang, Li, et al.
Published: (2024)

Dynamic Quality-Latency Aware Routing for LLM Inference in Wireless Edge-Device Networks
by: Bao, Rui, et al.
Published: (2025)

The Larger the Merrier? Efficient Large AI Model Inference in Wireless Edge Networks
by: Lyu, Zhonghao, et al.
Published: (2025)

Communication-Efficient Distributed On-Device LLM Inference Over Wireless Networks
by: Zhang, Kai, et al.
Published: (2025)

Transformer Redesign for Late Fusion of Audio-Text Features on Ultra-Low-Power Edge Hardware
by: Mitsis, Stavros, et al.
Published: (2025)

Early-Exit meets Model-Distributed Inference at Edge Networks
by: Colocrese, Marco, et al.
Published: (2024)

Resource-aware IoT Control: Saving Communication through Predictive Triggering
by: Trimpe, Sebastian, et al.
Published: (2019)

BayeSQP: Bayesian Optimization through Sequential Quadratic Programming
by: Brunzema, Paul, et al.
Published: (2026)

Hierarchical Event-triggered Learning for Cyclically Excited Systems with Application to Wireless Sensor Networks
by: Beuchert, Jonas, et al.
Published: (2019)

Distributed Inference with Minimal Off-Chip Traffic for Transformers on Low-Power MCUs
by: Bochem, Severin, et al.
Published: (2024)

CR^2: Cost-Aware Risk-Controlled Routing for Wireless Device-Edge LLM Inference
by: Xue, Nan, et al.
Published: (2026)

CoFormer: Collaborating with Heterogeneous Edge Devices for Scalable Transformer Inference
by: Xu, Guanyu, et al.
Published: (2025)

Robust Direct Data-Driven Control for Probabilistic Systems
by: von Rohr, Alexander, et al.
Published: (2023)

Fluid Dynamic DNNs for Reliable and Adaptive Distributed Inference on Edge Devices
by: Xun, Lei, et al.
Published: (2024)

Accelerating Depthwise Separable Convolutions on Ultra-Low-Power Devices
by: Daghero, Francesco, et al.
Published: (2024)

A Low-Power Streaming Speech Enhancement Accelerator For Edge Devices
by: Wu, Ci-Hao, et al.
Published: (2025)

A Compact, Low Power Transprecision ALU for Smart Edge Devices
by: Dube, Ayushi, et al.
Published: (2025)

SLIDE: Simultaneous Model Downloading and Inference at the Wireless Network Edge
by: Qu, Guanqiao, et al.
Published: (2025)