Improving Visual Place Recognition with Sequence-Matching Receptiveness Prediction

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hussaini, Somayeh, Fischer, Tobias, Milford, Michael
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916867688366080
author Hussaini, Somayeh
Fischer, Tobias
Milford, Michael
author_facet Hussaini, Somayeh
Fischer, Tobias
Milford, Michael
contents In visual place recognition (VPR), filtering and sequence-based matching approaches can improve performance by integrating temporal information across image sequences, especially in challenging conditions. While these methods are commonly applied, their effects on system behavior can be unpredictable and can actually make performance worse in certain situations. In this work, we present a new supervised learning approach that learns to predict the per-frame sequence matching receptiveness (SMR) of VPR techniques, enabling the system to selectively decide when to trust the output of a sequence matching system. Our approach is agnostic to the underlying VPR technique and effectively predicts SMR, and hence significantly improves VPR performance across a large range of state-of-the-art and classical VPR techniques (namely CosPlace, MixVPR, EigenPlaces, SALAD, AP-GeM, NetVLAD and SAD), and across three benchmark VPR datasets (Nordland, Oxford RobotCar, and SFU-Mountain). We also provide insights into a complementary approach that uses the predictor to replace discarded matches, and present ablation studies including an analysis of the interactions between our SMR predictor and the selected sequence length.
format Preprint
id arxiv_https___arxiv_org_abs_2503_06840
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Improving Visual Place Recognition with Sequence-Matching Receptiveness Prediction
Hussaini, Somayeh
Fischer, Tobias
Milford, Michael
Computer Vision and Pattern Recognition
In visual place recognition (VPR), filtering and sequence-based matching approaches can improve performance by integrating temporal information across image sequences, especially in challenging conditions. While these methods are commonly applied, their effects on system behavior can be unpredictable and can actually make performance worse in certain situations. In this work, we present a new supervised learning approach that learns to predict the per-frame sequence matching receptiveness (SMR) of VPR techniques, enabling the system to selectively decide when to trust the output of a sequence matching system. Our approach is agnostic to the underlying VPR technique and effectively predicts SMR, and hence significantly improves VPR performance across a large range of state-of-the-art and classical VPR techniques (namely CosPlace, MixVPR, EigenPlaces, SALAD, AP-GeM, NetVLAD and SAD), and across three benchmark VPR datasets (Nordland, Oxford RobotCar, and SFU-Mountain). We also provide insights into a complementary approach that uses the predictor to replace discarded matches, and present ablation studies including an analysis of the interactions between our SMR predictor and the selected sequence length.
title Improving Visual Place Recognition with Sequence-Matching Receptiveness Prediction
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.06840