Saved in:
Bibliographic Details
Main Authors: Biswas, Amrijit, Hossain, Md. Ismail, Elahi, M M Lutfe, Cheraghian, Ali, Rahman, Fuad, Mohammed, Nabeel, Rahman, Shafin
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2408.14601
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910577962516480
author Biswas, Amrijit
Hossain, Md. Ismail
Elahi, M M Lutfe
Cheraghian, Ali
Rahman, Fuad
Mohammed, Nabeel
Rahman, Shafin
author_facet Biswas, Amrijit
Hossain, Md. Ismail
Elahi, M M Lutfe
Cheraghian, Ali
Rahman, Fuad
Mohammed, Nabeel
Rahman, Shafin
contents A point cloud is a crucial geometric data structure utilized in numerous applications. The adoption of deep neural networks referred to as Point Cloud Neural Networks (PC- NNs), for processing 3D point clouds, has significantly advanced fields that rely on 3D geometric data to enhance the efficiency of tasks. Expanding the size of both neural network models and 3D point clouds introduces significant challenges in minimizing computational and memory requirements. This is essential for meeting the demanding requirements of real-world applications, which prioritize minimal energy consumption and low latency. Therefore, investigating redundancy in PCNNs is crucial yet challenging due to their sensitivity to parameters. Additionally, traditional pruning methods face difficulties as these networks rely heavily on weights and points. Nonetheless, our research reveals a promising phenomenon that could refine standard PCNN pruning techniques. Our findings suggest that preserving only the top p% of the highest magnitude weights is crucial for accuracy preservation. For example, pruning 99% of the weights from the PointNet model still results in accuracy close to the base level. Specifically, in the ModelNet40 dataset, where the base accuracy with the PointNet model was 87. 5%, preserving only 1% of the weights still achieves an accuracy of 86.8%. Codes are available in: https://github.com/apurba-nsu-rnd-lab/PCNN_Pruning
format Preprint
id arxiv_https___arxiv_org_abs_2408_14601
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle 3D Point Cloud Network Pruning: When Some Weights Do not Matter
Biswas, Amrijit
Hossain, Md. Ismail
Elahi, M M Lutfe
Cheraghian, Ali
Rahman, Fuad
Mohammed, Nabeel
Rahman, Shafin
Computer Vision and Pattern Recognition
A point cloud is a crucial geometric data structure utilized in numerous applications. The adoption of deep neural networks referred to as Point Cloud Neural Networks (PC- NNs), for processing 3D point clouds, has significantly advanced fields that rely on 3D geometric data to enhance the efficiency of tasks. Expanding the size of both neural network models and 3D point clouds introduces significant challenges in minimizing computational and memory requirements. This is essential for meeting the demanding requirements of real-world applications, which prioritize minimal energy consumption and low latency. Therefore, investigating redundancy in PCNNs is crucial yet challenging due to their sensitivity to parameters. Additionally, traditional pruning methods face difficulties as these networks rely heavily on weights and points. Nonetheless, our research reveals a promising phenomenon that could refine standard PCNN pruning techniques. Our findings suggest that preserving only the top p% of the highest magnitude weights is crucial for accuracy preservation. For example, pruning 99% of the weights from the PointNet model still results in accuracy close to the base level. Specifically, in the ModelNet40 dataset, where the base accuracy with the PointNet model was 87. 5%, preserving only 1% of the weights still achieves an accuracy of 86.8%. Codes are available in: https://github.com/apurba-nsu-rnd-lab/PCNN_Pruning
title 3D Point Cloud Network Pruning: When Some Weights Do not Matter
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2408.14601