Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2404.07236 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914750198185984 |
|---|---|
| author | Liu, Hou-I Galindo, Marco Xie, Hongxia Wong, Lai-Kuan Shuai, Hong-Han Li, Yung-Hui Cheng, Wen-Huang |
| author_facet | Liu, Hou-I Galindo, Marco Xie, Hongxia Wong, Lai-Kuan Shuai, Hong-Han Li, Yung-Hui Cheng, Wen-Huang |
| contents | Over the past decade, the dominance of deep learning has prevailed across various domains of artificial intelligence, including natural language processing, computer vision, and biomedical signal processing. While there have been remarkable improvements in model accuracy, deploying these models on lightweight devices, such as mobile phones and microcontrollers, is constrained by limited resources. In this survey, we provide comprehensive design guidance tailored for these devices, detailing the meticulous design of lightweight models, compression methods, and hardware acceleration strategies. The principal goal of this work is to explore methods and concepts for getting around hardware constraints without compromising the model's accuracy. Additionally, we explore two notable paths for lightweight deep learning in the future: deployment techniques for TinyML and Large Language Models. Although these paths undoubtedly have potential, they also present significant challenges, encouraging research into unexplored areas. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_07236 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Lightweight Deep Learning for Resource-Constrained Environments: A Survey Liu, Hou-I Galindo, Marco Xie, Hongxia Wong, Lai-Kuan Shuai, Hong-Han Li, Yung-Hui Cheng, Wen-Huang Computer Vision and Pattern Recognition Machine Learning Over the past decade, the dominance of deep learning has prevailed across various domains of artificial intelligence, including natural language processing, computer vision, and biomedical signal processing. While there have been remarkable improvements in model accuracy, deploying these models on lightweight devices, such as mobile phones and microcontrollers, is constrained by limited resources. In this survey, we provide comprehensive design guidance tailored for these devices, detailing the meticulous design of lightweight models, compression methods, and hardware acceleration strategies. The principal goal of this work is to explore methods and concepts for getting around hardware constraints without compromising the model's accuracy. Additionally, we explore two notable paths for lightweight deep learning in the future: deployment techniques for TinyML and Large Language Models. Although these paths undoubtedly have potential, they also present significant challenges, encouraging research into unexplored areas. |
| title | Lightweight Deep Learning for Resource-Constrained Environments: A Survey |
| topic | Computer Vision and Pattern Recognition Machine Learning |
| url | https://arxiv.org/abs/2404.07236 |