Single Domain Generalization for Few-Shot Counting via Universal Representation Matching

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Chen, Xianing, Huo, Si, Jiang, Borui, Hu, Hailin, Chen, Xinghao
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913853215866880
author Chen, Xianing
Huo, Si
Jiang, Borui
Hu, Hailin
Chen, Xinghao
author_facet Chen, Xianing
Huo, Si
Jiang, Borui
Hu, Hailin
Chen, Xinghao
contents Few-shot counting estimates the number of target objects in an image using only a few annotated exemplars. However, domain shift severely hinders existing methods to generalize to unseen scenarios. This falls into the realm of single domain generalization that remains unexplored in few-shot counting. To solve this problem, we begin by analyzing the main limitations of current methods, which typically follow a standard pipeline that extract the object prototypes from exemplars and then match them with image feature to construct the correlation map. We argue that existing methods overlook the significance of learning highly generalized prototypes. Building on this insight, we propose the first single domain generalization few-shot counting model, Universal Representation Matching, termed URM. Our primary contribution is the discovery that incorporating universal vision-language representations distilled from a large scale pretrained vision-language model into the correlation construction process substantially improves robustness to domain shifts without compromising in domain performance. As a result, URM achieves state-of-the-art performance on both in domain and the newly introduced domain generalization setting.
format Preprint
id arxiv_https___arxiv_org_abs_2505_16778
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Single Domain Generalization for Few-Shot Counting via Universal Representation Matching
Chen, Xianing
Huo, Si
Jiang, Borui
Hu, Hailin
Chen, Xinghao
Computer Vision and Pattern Recognition
Few-shot counting estimates the number of target objects in an image using only a few annotated exemplars. However, domain shift severely hinders existing methods to generalize to unseen scenarios. This falls into the realm of single domain generalization that remains unexplored in few-shot counting. To solve this problem, we begin by analyzing the main limitations of current methods, which typically follow a standard pipeline that extract the object prototypes from exemplars and then match them with image feature to construct the correlation map. We argue that existing methods overlook the significance of learning highly generalized prototypes. Building on this insight, we propose the first single domain generalization few-shot counting model, Universal Representation Matching, termed URM. Our primary contribution is the discovery that incorporating universal vision-language representations distilled from a large scale pretrained vision-language model into the correlation construction process substantially improves robustness to domain shifts without compromising in domain performance. As a result, URM achieves state-of-the-art performance on both in domain and the newly introduced domain generalization setting.
title Single Domain Generalization for Few-Shot Counting via Universal Representation Matching
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.16778