Saved in:
Bibliographic Details
Main Author: Ma, Xiaotian
Format: Recurso digital
Language:English
Published: Zenodo 2023
Subjects:
Online Access:https://doi.org/10.5281/zenodo.10403761
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866901524456669184
author Ma, Xiaotian
author_facet Ma, Xiaotian
contents <p>As deep neural networks continue to drive advancements in computer vision tasks, researchers are increasingly focusing on developing powerful deep neural network models to handle large volumes of data. As the size of DNN models grows, their inference process becomes computationally expensive, which limits the real-time applications of DNNs. In response to this challenge, we propose a universal framework called "Locality Sensing and Optimized Neural Network for Video Processing SPEED-UP." This framework utilizes locality sensing to accelerate the video query processing, reducing the computational costs of DNNs in video evaluation and achieving a threefold reduction in inference time.</p> <p>This framework can automatically sense the similarity between two input frames within a given input video. It enables us to process input videos using a specialized processing method that incurs significantly lower computational costs compared to traditional DNN inference, which involves frame-by-frame detection. Within the highlighted temporal locality information across frames, the Yolov5 algorithm can achieve a two to threefold speedup. Furthermore, we employ neural network compression techniques to reduce the size of the neural network without sacrificing minimal accuracy, ultimately compressing the neural network volume by half. The simultaneous use of these two methods validates the effectiveness of our research.</p>
format Recurso digital
id zenodo_https___doi_org_10_5281_zenodo_10403761
institution Zenodo
language eng
publishDate 2023
publisher Zenodo
record_format zenodo
spellingShingle JOINT OPTIMIZATION OF LOCAL SENSING AND NEURAL NETWORKS FOR VIDEO PROCESSING SPEED-UP
Ma, Xiaotian
network pruning
binarization
computer vision
convolution
<p>As deep neural networks continue to drive advancements in computer vision tasks, researchers are increasingly focusing on developing powerful deep neural network models to handle large volumes of data. As the size of DNN models grows, their inference process becomes computationally expensive, which limits the real-time applications of DNNs. In response to this challenge, we propose a universal framework called "Locality Sensing and Optimized Neural Network for Video Processing SPEED-UP." This framework utilizes locality sensing to accelerate the video query processing, reducing the computational costs of DNNs in video evaluation and achieving a threefold reduction in inference time.</p> <p>This framework can automatically sense the similarity between two input frames within a given input video. It enables us to process input videos using a specialized processing method that incurs significantly lower computational costs compared to traditional DNN inference, which involves frame-by-frame detection. Within the highlighted temporal locality information across frames, the Yolov5 algorithm can achieve a two to threefold speedup. Furthermore, we employ neural network compression techniques to reduce the size of the neural network without sacrificing minimal accuracy, ultimately compressing the neural network volume by half. The simultaneous use of these two methods validates the effectiveness of our research.</p>
title JOINT OPTIMIZATION OF LOCAL SENSING AND NEURAL NETWORKS FOR VIDEO PROCESSING SPEED-UP
topic network pruning
binarization
computer vision
convolution
url https://doi.org/10.5281/zenodo.10403761