Ghost-dil-NetVLAD: A Lightweight Neural Network for Visual Place Recognition

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gong, Qingyuan, Liu, Yu, Zhang, Liqiang, Liu, Renhe
Format: Preprint
Published: 2021
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911840943996928
author Gong, Qingyuan
Liu, Yu
Zhang, Liqiang
Liu, Renhe
author_facet Gong, Qingyuan
Liu, Yu
Zhang, Liqiang
Liu, Renhe
contents Visual place recognition (VPR) is a challenging task with the unbalance between enormous computational cost and high recognition performance. Thanks to the practical feature extraction ability of the lightweight convolution neural networks (CNNs) and the train-ability of the vector of locally aggregated descriptors (VLAD) layer, we propose a lightweight weakly supervised end-to-end neural network consisting of a front-ended perception model called GhostCNN and a learnable VLAD layer as a back-end. GhostCNN is based on Ghost modules that are lightweight CNN-based architectures. They can generate redundant feature maps using linear operations instead of the traditional convolution process, making a good trade-off between computation resources and recognition accuracy. To enhance our proposed lightweight model further, we add dilated convolutions to the Ghost module to get features containing more spatial semantic information, improving accuracy. Finally, rich experiments conducted on a commonly used public benchmark and our private dataset validate that the proposed neural network reduces the FLOPs and parameters of VGG16-NetVLAD by 99.04% and 80.16%, respectively. Besides, both models achieve similar accuracy.
format Preprint
id arxiv_https___arxiv_org_abs_2112_11679
institution arXiv
publishDate 2021
record_format arxiv
spellingShingle Ghost-dil-NetVLAD: A Lightweight Neural Network for Visual Place Recognition
Gong, Qingyuan
Liu, Yu
Zhang, Liqiang
Liu, Renhe
Computer Vision and Pattern Recognition
Visual place recognition (VPR) is a challenging task with the unbalance between enormous computational cost and high recognition performance. Thanks to the practical feature extraction ability of the lightweight convolution neural networks (CNNs) and the train-ability of the vector of locally aggregated descriptors (VLAD) layer, we propose a lightweight weakly supervised end-to-end neural network consisting of a front-ended perception model called GhostCNN and a learnable VLAD layer as a back-end. GhostCNN is based on Ghost modules that are lightweight CNN-based architectures. They can generate redundant feature maps using linear operations instead of the traditional convolution process, making a good trade-off between computation resources and recognition accuracy. To enhance our proposed lightweight model further, we add dilated convolutions to the Ghost module to get features containing more spatial semantic information, improving accuracy. Finally, rich experiments conducted on a commonly used public benchmark and our private dataset validate that the proposed neural network reduces the FLOPs and parameters of VGG16-NetVLAD by 99.04% and 80.16%, respectively. Besides, both models achieve similar accuracy.
title Ghost-dil-NetVLAD: A Lightweight Neural Network for Visual Place Recognition
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2112.11679