Saved in:
Bibliographic Details
Main Authors: Catalano, Nico, Samele, Stefano, Pertino, Paolo, Matteucci, Matteo
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2504.07942
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911067336081408
author Catalano, Nico
Samele, Stefano
Pertino, Paolo
Matteucci, Matteo
author_facet Catalano, Nico
Samele, Stefano
Pertino, Paolo
Matteucci, Matteo
contents Few Shot Segmentation aims to segment novel object classes given only a handful of labeled examples, enabling rapid adaptation with minimal supervision. Current literature crucially lacks a selection method that goes beyond visual similarity between the query and example images, leading to suboptimal predictions. We present MARS, a plug-and-play ranking system that leverages multimodal cues to filter and merge mask proposals robustly. Starting from a set of mask predictions for a single query image, we score, filter, and merge them to improve results. Proposals are evaluated using multimodal scores computed at local and global levels. Extensive experiments on COCO-20i, Pascal-5i, LVIS-92i, and FSS-1000 demonstrate that integrating all four scoring components is crucial for robust ranking, validating our contribution. As MARS can be effortlessly integrated with various mask proposal systems, we deploy it across a wide range of top-performer methods and achieve new state-of-the-art results on multiple existing benchmarks. Code will be available upon acceptance.
format Preprint
id arxiv_https___arxiv_org_abs_2504_07942
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MARS: a Multimodal Alignment and Ranking System for Few-Shot Segmentation
Catalano, Nico
Samele, Stefano
Pertino, Paolo
Matteucci, Matteo
Computer Vision and Pattern Recognition
Few Shot Segmentation aims to segment novel object classes given only a handful of labeled examples, enabling rapid adaptation with minimal supervision. Current literature crucially lacks a selection method that goes beyond visual similarity between the query and example images, leading to suboptimal predictions. We present MARS, a plug-and-play ranking system that leverages multimodal cues to filter and merge mask proposals robustly. Starting from a set of mask predictions for a single query image, we score, filter, and merge them to improve results. Proposals are evaluated using multimodal scores computed at local and global levels. Extensive experiments on COCO-20i, Pascal-5i, LVIS-92i, and FSS-1000 demonstrate that integrating all four scoring components is crucial for robust ranking, validating our contribution. As MARS can be effortlessly integrated with various mask proposal systems, we deploy it across a wide range of top-performer methods and achieve new state-of-the-art results on multiple existing benchmarks. Code will be available upon acceptance.
title MARS: a Multimodal Alignment and Ranking System for Few-Shot Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.07942