Lightweight Design and Optimization methods for DCNNs: Progress and Futures

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Long, Hanhua, Bi, Wenbin, Sun, Jian
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917876246511616
author Long, Hanhua
Bi, Wenbin
Sun, Jian
author_facet Long, Hanhua
Bi, Wenbin
Sun, Jian
contents Lightweight design, as a key approach to mitigate disparity between computational requirements of deep learning models and hardware performance, plays a pivotal role in advancing application of deep learning technologies on mobile and embedded devices, alongside rapid development of smart home, telemedicine, and autonomous driving. With its outstanding feature extracting capabilities, Deep Convolutional Neural Networks (DCNNs) have demonstrated superior performance in computer vision tasks. However, high computational costs and large network architectures severely limit the widespread application of DCNNs on resource-constrained hardware platforms such as smartphones, robots, and IoT devices. This paper reviews lightweight design strategies for DCNNs and examines recent research progress in both lightweight architectural design and model compression. Additionally, this paper discusses current limitations in this field of research and propose prospects for future directions, aiming to provide valuable guidance and reflection for lightweight design philosophy on deep neural networks in the field of computer vision.
format Preprint
id arxiv_https___arxiv_org_abs_2412_16886
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Lightweight Design and Optimization methods for DCNNs: Progress and Futures
Long, Hanhua
Bi, Wenbin
Sun, Jian
Computer Vision and Pattern Recognition
Lightweight design, as a key approach to mitigate disparity between computational requirements of deep learning models and hardware performance, plays a pivotal role in advancing application of deep learning technologies on mobile and embedded devices, alongside rapid development of smart home, telemedicine, and autonomous driving. With its outstanding feature extracting capabilities, Deep Convolutional Neural Networks (DCNNs) have demonstrated superior performance in computer vision tasks. However, high computational costs and large network architectures severely limit the widespread application of DCNNs on resource-constrained hardware platforms such as smartphones, robots, and IoT devices. This paper reviews lightweight design strategies for DCNNs and examines recent research progress in both lightweight architectural design and model compression. Additionally, this paper discusses current limitations in this field of research and propose prospects for future directions, aiming to provide valuable guidance and reflection for lightweight design philosophy on deep neural networks in the field of computer vision.
title Lightweight Design and Optimization methods for DCNNs: Progress and Futures
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.16886