Copertina

Tiny but Mighty: A Software-Hardware Co-Design Approach for Efficient Multimodal Inference on Battery-Powered Small Devices

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Li, Yilong, Zhang, Shuai, Zeng, Yijing, Zhang, Hao, Xiong, Xinmiao, Liu, Jingyu, Hu, Pan, Banerjee, Suman
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Distributed, Parallel, and Cluster Computing Artificial Intelligence Computation and Language Signal Processing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Benchmarking Compound AI Applications for Hardware-Software Co-Design
di: Samuthrsindh, Paramuth, et al.
Pubblicazione: (2026)

TokenSim: Enabling Hardware and Software Exploration for Large Language Model Inference Systems
di: Wu, Feiyang, et al.
Pubblicazione: (2025)

PICO: Pipeline Inference Framework for Versatile CNNs on Diverse Mobile Devices
di: Yang, Xiang, et al.
Pubblicazione: (2022)

Distributed On-Device LLM Inference With Over-the-Air Computation
di: Zhang, Kai, et al.
Pubblicazione: (2025)

Exploring the Boundaries of On-Device Inference: When Tiny Falls Short, Go Hierarchical
di: Behera, Adarsh Prasad, et al.
Pubblicazione: (2024)

ReviveMoE: Fast Recovery for Hardware Failures in Large-Scale MoE LLM Inference Deployments
di: Li, Haley, et al.
Pubblicazione: (2026)

Multi-core & GPU-based Balanced Butterfly Counting in Signed Bipartite Graphs
di: Kiran, Mekala, et al.
Pubblicazione: (2026)

AdaOper: Energy-efficient and Responsive Concurrent DNN Inference on Mobile Devices
di: Lin, Zheng, et al.
Pubblicazione: (2024)

LIME:Accelerating Collaborative Lossless LLM Inference on Memory-Constrained Edge Devices
di: Sun, Mingyu, et al.
Pubblicazione: (2025)

Fire-Flyer AI-HPC: A Cost-Effective Software-Hardware Co-Design for Deep Learning
di: An, Wei, et al.
Pubblicazione: (2024)

Arrow: Adaptive Scheduling Mechanisms for Disaggregated LLM Inference Architecture
di: Wu, Yu, et al.
Pubblicazione: (2025)

Adaptive Heuristics for Scheduling DNN Inferencing on Edge and Cloud for Personalized UAV Fleets
di: Raj, Suman, et al.
Pubblicazione: (2024)

Loki: A System for Serving ML Inference Pipelines with Hardware and Accuracy Scaling
di: Ahmad, Sohaib, et al.
Pubblicazione: (2024)

FlexPie: Accelerate Distributed Inference on Edge Devices with Flexible Combinatorial Optimization[Technical Report]
di: Zhang, Runhua, et al.
Pubblicazione: (2025)

Pico-Cloud: Cloud Infrastructure for Tiny Edge Devices
di: Guri, Mordechai
Pubblicazione: (2025)

SLO-Aware Scheduling for Large Language Model Inferences
di: Huang, Jinqi, et al.
Pubblicazione: (2025)

Power Aware Dynamic Reallocation For Inference
di: Jiang, Yiwei, et al.
Pubblicazione: (2026)

Optimizing Hardware Resource Partitioning and Job Allocations on Modern GPUs under Power Caps
di: Arima, Eishi, et al.
Pubblicazione: (2024)

CoCoI: Distributed Coded Inference System for Straggler Mitigation
di: Liu, Xing, et al.
Pubblicazione: (2025)

GPUArmor: A Hardware-Software Co-design for Efficient and Scalable Memory Safety on GPUs
di: Ziad, Mohamed Tarek Ibn, et al.
Pubblicazione: (2025)

Evaluating Multi-Instance DNN Inferencing on Multiple Accelerators of an Edge Device
di: Tayal, Mumuksh, et al.
Pubblicazione: (2025)

SLICE: SLO-Driven Scheduling for LLM Inference on Edge Computing Devices
di: Chow, Will
Pubblicazione: (2025)

Energy-aware Incremental OTA Update for Flash-based Batteryless IoT Devices
di: Wei, Wei, et al.
Pubblicazione: (2024)

Understanding the Performance and Power of LLM Inferencing on Edge Accelerators
di: Arya, Mayank, et al.
Pubblicazione: (2025)

xNVMe: Unleashing Storage Hardware-Software Co-design
di: Lund, Simon A. F., et al.
Pubblicazione: (2024)

Improved Decision Module Selection for Hierarchical Inference in Resource-Constrained Edge Devices
di: Behera, Adarsh Prasad, et al.
Pubblicazione: (2024)

Distributed Generative Inference of LLM at Internet Scales with Multi-Dimensional Communication Optimization
di: Chen, Jiu, et al.
Pubblicazione: (2026)

Extracting the Potential of Emerging Hardware Accelerators for Symmetric Eigenvalue Decomposition
di: Wang, Hansheng, et al.
Pubblicazione: (2024)

Cicada: A Pipeline-Efficient Approach to Serverless Inference with Decoupled Management
di: Wu, Z., et al.
Pubblicazione: (2025)

DynaSplit: A Hardware-Software Co-Design Framework for Energy-Aware Inference on Edge
di: May, Daniel, et al.
Pubblicazione: (2024)

MoA-Off: Adaptive Heterogeneous Modality-Aware Offloading with Edge-Cloud Collaboration for Efficient Multimodal LLM Inference
di: Yang, Zheming, et al.
Pubblicazione: (2025)

Joint Optimization of Offloading, Batching and DVFS for Multiuser Co-Inference
di: Xu, Yaodan, et al.
Pubblicazione: (2025)

LLM-CoOpt: A Co-Design and Optimization Framework for Efficient LLM Inference on Heterogeneous Platforms
di: Kong, Jie, et al.
Pubblicazione: (2026)

Adaptive Device-Edge Collaboration on DNN Inference in AIoT: A Digital Twin-Assisted Approach
di: Hu, Shisheng, et al.
Pubblicazione: (2024)

CoCoDiff: Optimizing Collective Communications for Distributed Diffusion Transformer Inference Under Ulysses Sequence Parallelism
di: Ma, Bin, et al.
Pubblicazione: (2026)

PIM-SHERPA: Software Method for On-device LLM Inference by Resolving PIM Memory Attribute and Layout Inconsistencies
di: Lee, Sunjung, et al.
Pubblicazione: (2026)

TT-Edge: A Hardware-Software Co-Design for Energy-Efficient Tensor-Train Decomposition on Edge AI
di: Kwak, Hyunseok, et al.
Pubblicazione: (2025)

ReaLB: Real-Time Load Balancing for Multimodal MoE Inference
di: Wang, Yingping, et al.
Pubblicazione: (2026)

Future-Proofing IoT: Unleashing the Power of AWS Greengrass in Propelling Smart Devices to New Heights
di: Kokkula, Sahasra, et al.
Pubblicazione: (2024)

SimDC: A High-Fidelity Device Simulation Platform for Device-Cloud Collaborative Computing
di: Pei, Ruiguang, et al.
Pubblicazione: (2025)