Saved in:
Bibliographic Details
Main Authors: Liu, Hou-I, Galindo, Marco, Xie, Hongxia, Wong, Lai-Kuan, Shuai, Hong-Han, Li, Yung-Hui, Cheng, Wen-Huang
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2404.07236
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914750198185984
author Liu, Hou-I
Galindo, Marco
Xie, Hongxia
Wong, Lai-Kuan
Shuai, Hong-Han
Li, Yung-Hui
Cheng, Wen-Huang
author_facet Liu, Hou-I
Galindo, Marco
Xie, Hongxia
Wong, Lai-Kuan
Shuai, Hong-Han
Li, Yung-Hui
Cheng, Wen-Huang
contents Over the past decade, the dominance of deep learning has prevailed across various domains of artificial intelligence, including natural language processing, computer vision, and biomedical signal processing. While there have been remarkable improvements in model accuracy, deploying these models on lightweight devices, such as mobile phones and microcontrollers, is constrained by limited resources. In this survey, we provide comprehensive design guidance tailored for these devices, detailing the meticulous design of lightweight models, compression methods, and hardware acceleration strategies. The principal goal of this work is to explore methods and concepts for getting around hardware constraints without compromising the model's accuracy. Additionally, we explore two notable paths for lightweight deep learning in the future: deployment techniques for TinyML and Large Language Models. Although these paths undoubtedly have potential, they also present significant challenges, encouraging research into unexplored areas.
format Preprint
id arxiv_https___arxiv_org_abs_2404_07236
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Lightweight Deep Learning for Resource-Constrained Environments: A Survey
Liu, Hou-I
Galindo, Marco
Xie, Hongxia
Wong, Lai-Kuan
Shuai, Hong-Han
Li, Yung-Hui
Cheng, Wen-Huang
Computer Vision and Pattern Recognition
Machine Learning
Over the past decade, the dominance of deep learning has prevailed across various domains of artificial intelligence, including natural language processing, computer vision, and biomedical signal processing. While there have been remarkable improvements in model accuracy, deploying these models on lightweight devices, such as mobile phones and microcontrollers, is constrained by limited resources. In this survey, we provide comprehensive design guidance tailored for these devices, detailing the meticulous design of lightweight models, compression methods, and hardware acceleration strategies. The principal goal of this work is to explore methods and concepts for getting around hardware constraints without compromising the model's accuracy. Additionally, we explore two notable paths for lightweight deep learning in the future: deployment techniques for TinyML and Large Language Models. Although these paths undoubtedly have potential, they also present significant challenges, encouraging research into unexplored areas.
title Lightweight Deep Learning for Resource-Constrained Environments: A Survey
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2404.07236