RUBIK: A Structured Benchmark for Image Matching across Geometric Challenges

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Loiseau, Thibaut, Bourmaud, Guillaume
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917939198820352
author Loiseau, Thibaut
Bourmaud, Guillaume
author_facet Loiseau, Thibaut
Bourmaud, Guillaume
contents Camera pose estimation is crucial for many computer vision applications, yet existing benchmarks offer limited insight into method limitations across different geometric challenges. We introduce RUBIK, a novel benchmark that systematically evaluates image matching methods across well-defined geometric difficulty levels. Using three complementary criteria - overlap, scale ratio, and viewpoint angle - we organize 16.5K image pairs from nuScenes into 33 difficulty levels. Our comprehensive evaluation of 14 methods reveals that while recent detector-free approaches achieve the best performance (>47% success rate), they come with significant computational overhead compared to detector-based methods (150-600ms vs. 40-70ms). Even the best performing method succeeds on only 54.8% of the pairs, highlighting substantial room for improvement, particularly in challenging scenarios combining low overlap, large scale differences, and extreme viewpoint changes. Benchmark will be made publicly available.
format Preprint
id arxiv_https___arxiv_org_abs_2502_19955
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle RUBIK: A Structured Benchmark for Image Matching across Geometric Challenges
Loiseau, Thibaut
Bourmaud, Guillaume
Computer Vision and Pattern Recognition
Camera pose estimation is crucial for many computer vision applications, yet existing benchmarks offer limited insight into method limitations across different geometric challenges. We introduce RUBIK, a novel benchmark that systematically evaluates image matching methods across well-defined geometric difficulty levels. Using three complementary criteria - overlap, scale ratio, and viewpoint angle - we organize 16.5K image pairs from nuScenes into 33 difficulty levels. Our comprehensive evaluation of 14 methods reveals that while recent detector-free approaches achieve the best performance (>47% success rate), they come with significant computational overhead compared to detector-based methods (150-600ms vs. 40-70ms). Even the best performing method succeeds on only 54.8% of the pairs, highlighting substantial room for improvement, particularly in challenging scenarios combining low overlap, large scale differences, and extreme viewpoint changes. Benchmark will be made publicly available.
title RUBIK: A Structured Benchmark for Image Matching across Geometric Challenges
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2502.19955