MPTF-Net: Multi-view Pyramid Transformer Fusion Network for LiDAR-based Place Recognition

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Shuyuan, Wang, Zihang, Chen, Xieyuanli, Zhu, Wenkai, Fang, Xiaoteng, Ni, Peizhou, Yang, Junhao, Kong, Dong
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908939723997184
author Li, Shuyuan
Wang, Zihang
Chen, Xieyuanli
Zhu, Wenkai
Fang, Xiaoteng
Ni, Peizhou
Yang, Junhao
Kong, Dong
author_facet Li, Shuyuan
Wang, Zihang
Chen, Xieyuanli
Zhu, Wenkai
Fang, Xiaoteng
Ni, Peizhou
Yang, Junhao
Kong, Dong
contents LiDAR-based place recognition (LPR) is essential for global localization and loop-closure detection in large-scale SLAM systems. Existing methods typically construct global descriptors from Range Images or BEV representations for matching. BEV is widely adopted due to its explicit 2D spatial layout encoding and efficient retrieval. However, conventional BEV representations rely on simple statistical aggregation, which fails to capture fine-grained geometric structures, leading to performance degradation in complex or repetitive environments. To address this, we propose MPTF-Net, a novel multi-view multi-scale pyramid Transformer fusion network. Our core contribution is a multi-channel NDT-based BEV encoding that explicitly models local geometric complexity and intensity distributions via Normal Distribution Transform, providing a noise-resilient structural prior. To effectively integrate these features, we develop a customized pyramid Transformer module that captures cross-view interactive correlations between Range Image Views (RIV) and NDT-BEV at multiple spatial scales. Extensive experiments on the nuScenes, KITTI and NCLT datasets demonstrate that MPTF-Net achieves state-of-the-art performance, specifically attaining a Recall@1 of 96.31\% on the nuScenes Boston split while maintaining an inference latency of only 10.02 ms, making it highly suitable for real-time autonomous unmanned systems.
format Preprint
id arxiv_https___arxiv_org_abs_2604_04513
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle MPTF-Net: Multi-view Pyramid Transformer Fusion Network for LiDAR-based Place Recognition
Li, Shuyuan
Wang, Zihang
Chen, Xieyuanli
Zhu, Wenkai
Fang, Xiaoteng
Ni, Peizhou
Yang, Junhao
Kong, Dong
Computer Vision and Pattern Recognition
Robotics
LiDAR-based place recognition (LPR) is essential for global localization and loop-closure detection in large-scale SLAM systems. Existing methods typically construct global descriptors from Range Images or BEV representations for matching. BEV is widely adopted due to its explicit 2D spatial layout encoding and efficient retrieval. However, conventional BEV representations rely on simple statistical aggregation, which fails to capture fine-grained geometric structures, leading to performance degradation in complex or repetitive environments. To address this, we propose MPTF-Net, a novel multi-view multi-scale pyramid Transformer fusion network. Our core contribution is a multi-channel NDT-based BEV encoding that explicitly models local geometric complexity and intensity distributions via Normal Distribution Transform, providing a noise-resilient structural prior. To effectively integrate these features, we develop a customized pyramid Transformer module that captures cross-view interactive correlations between Range Image Views (RIV) and NDT-BEV at multiple spatial scales. Extensive experiments on the nuScenes, KITTI and NCLT datasets demonstrate that MPTF-Net achieves state-of-the-art performance, specifically attaining a Recall@1 of 96.31\% on the nuScenes Boston split while maintaining an inference latency of only 10.02 ms, making it highly suitable for real-time autonomous unmanned systems.
title MPTF-Net: Multi-view Pyramid Transformer Fusion Network for LiDAR-based Place Recognition
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2604.04513