ELViS: Efficient Visual Similarity from Local Descriptors that Generalizes Across Domains

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Suma, Pavel, Kordopatis-Zilos, Giorgos, Kalantidis, Yannis, Tolias, Giorgos
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917369751797760
author Suma, Pavel
Kordopatis-Zilos, Giorgos
Kalantidis, Yannis
Tolias, Giorgos
author_facet Suma, Pavel
Kordopatis-Zilos, Giorgos
Kalantidis, Yannis
Tolias, Giorgos
contents Large-scale instance-level training data is scarce, so models are typically trained on domain-specific datasets. Yet in real-world retrieval, they must handle diverse domains, making generalization to unseen data critical. We introduce ELViS, an image-to-image similarity model that generalizes effectively to unseen domains. Unlike conventional approaches, our model operates in similarity space rather than representation space, promoting cross-domain transfer. It leverages local descriptor correspondences, refines their similarities through an optimal transport step with data-dependent gains that suppress uninformative descriptors, and aggregates strong correspondences via a voting process into an image-level similarity. This design injects strong inductive biases, yielding a simple, efficient, and interpretable model. To assess generalization, we compile a benchmark of eight datasets spanning landmarks, artworks, products, and multi-domain collections, and evaluate ELViS as a re-ranking method. Our experiments show that ELViS outperforms competing methods by a large margin in out-of-domain scenarios and on average, while requiring only a fraction of their computational cost. Code available at: https://github.com/pavelsuma/ELViS/
format Preprint
id arxiv_https___arxiv_org_abs_2603_28603
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle ELViS: Efficient Visual Similarity from Local Descriptors that Generalizes Across Domains
Suma, Pavel
Kordopatis-Zilos, Giorgos
Kalantidis, Yannis
Tolias, Giorgos
Computer Vision and Pattern Recognition
Large-scale instance-level training data is scarce, so models are typically trained on domain-specific datasets. Yet in real-world retrieval, they must handle diverse domains, making generalization to unseen data critical. We introduce ELViS, an image-to-image similarity model that generalizes effectively to unseen domains. Unlike conventional approaches, our model operates in similarity space rather than representation space, promoting cross-domain transfer. It leverages local descriptor correspondences, refines their similarities through an optimal transport step with data-dependent gains that suppress uninformative descriptors, and aggregates strong correspondences via a voting process into an image-level similarity. This design injects strong inductive biases, yielding a simple, efficient, and interpretable model. To assess generalization, we compile a benchmark of eight datasets spanning landmarks, artworks, products, and multi-domain collections, and evaluate ELViS as a re-ranking method. Our experiments show that ELViS outperforms competing methods by a large margin in out-of-domain scenarios and on average, while requiring only a fraction of their computational cost. Code available at: https://github.com/pavelsuma/ELViS/
title ELViS: Efficient Visual Similarity from Local Descriptors that Generalizes Across Domains
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.28603