Empowering Edge Intelligence: A Comprehensive Survey on On-Device AI Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Xubin, Tang, Zhiqing, Guo, Jianxiong, Meng, Tianhui, Wang, Chenhao, Wang, Tian, Jia, Weijia
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912278303997952
author Wang, Xubin
Tang, Zhiqing
Guo, Jianxiong
Meng, Tianhui
Wang, Chenhao
Wang, Tian
Jia, Weijia
author_facet Wang, Xubin
Tang, Zhiqing
Guo, Jianxiong
Meng, Tianhui
Wang, Chenhao
Wang, Tian
Jia, Weijia
contents The rapid advancement of artificial intelligence (AI) technologies has led to an increasing deployment of AI models on edge and terminal devices, driven by the proliferation of the Internet of Things (IoT) and the need for real-time data processing. This survey comprehensively explores the current state, technical challenges, and future trends of on-device AI models. We define on-device AI models as those designed to perform local data processing and inference, emphasizing their characteristics such as real-time performance, resource constraints, and enhanced data privacy. The survey is structured around key themes, including the fundamental concepts of AI models, application scenarios across various domains, and the technical challenges faced in edge environments. We also discuss optimization and implementation strategies, such as data preprocessing, model compression, and hardware acceleration, which are essential for effective deployment. Furthermore, we examine the impact of emerging technologies, including edge computing and foundation models, on the evolution of on-device AI models. By providing a structured overview of the challenges, solutions, and future directions, this survey aims to facilitate further research and application of on-device AI, ultimately contributing to the advancement of intelligent systems in everyday life.
format Preprint
id arxiv_https___arxiv_org_abs_2503_06027
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Empowering Edge Intelligence: A Comprehensive Survey on On-Device AI Models
Wang, Xubin
Tang, Zhiqing
Guo, Jianxiong
Meng, Tianhui
Wang, Chenhao
Wang, Tian
Jia, Weijia
Artificial Intelligence
Machine Learning
Networking and Internet Architecture
The rapid advancement of artificial intelligence (AI) technologies has led to an increasing deployment of AI models on edge and terminal devices, driven by the proliferation of the Internet of Things (IoT) and the need for real-time data processing. This survey comprehensively explores the current state, technical challenges, and future trends of on-device AI models. We define on-device AI models as those designed to perform local data processing and inference, emphasizing their characteristics such as real-time performance, resource constraints, and enhanced data privacy. The survey is structured around key themes, including the fundamental concepts of AI models, application scenarios across various domains, and the technical challenges faced in edge environments. We also discuss optimization and implementation strategies, such as data preprocessing, model compression, and hardware acceleration, which are essential for effective deployment. Furthermore, we examine the impact of emerging technologies, including edge computing and foundation models, on the evolution of on-device AI models. By providing a structured overview of the challenges, solutions, and future directions, this survey aims to facilitate further research and application of on-device AI, ultimately contributing to the advancement of intelligent systems in everyday life.
title Empowering Edge Intelligence: A Comprehensive Survey on On-Device AI Models
topic Artificial Intelligence
Machine Learning
Networking and Internet Architecture
url https://arxiv.org/abs/2503.06027