DiffVAS: Diffusion-Guided Visual Active Search in Partially Observable Environments

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sarkar, Anindya, Sastry, Srikumar, Pirinen, Aleksis, Jacobs, Nathan, Vorobeychik, Yevgeniy
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911687671545856
author Sarkar, Anindya
Sastry, Srikumar
Pirinen, Aleksis
Jacobs, Nathan
Vorobeychik, Yevgeniy
author_facet Sarkar, Anindya
Sastry, Srikumar
Pirinen, Aleksis
Jacobs, Nathan
Vorobeychik, Yevgeniy
contents Visual active search (VAS) has been introduced as a modeling framework that leverages visual cues to direct aerial (e.g., UAV-based) exploration and pinpoint areas of interest within extensive geospatial regions. Potential applications of VAS include detecting hotspots for rare wildlife poaching, aiding search-and-rescue missions, and uncovering illegal trafficking of weapons, among other uses. Previous VAS approaches assume that the entire search space is known upfront, which is often unrealistic due to constraints such as a restricted field of view and high acquisition costs, and they typically learn policies tailored to specific target objects, which limits their ability to search for multiple target categories simultaneously. In this work, we propose DiffVAS, a target-conditioned policy that searches for diverse objects simultaneously according to task requirements in partially observable environments, which advances the deployment of visual active search policies in real-world applications. DiffVAS leverages a diffusion model to reconstruct the entire geospatial area from sequentially observed partial glimpses, which enables a target-conditioned reinforcement learning-based planning module to effectively reason and guide subsequent search steps. Extensive experiments demonstrate that DiffVAS excels in searching diverse objects in partially observable environments, significantly surpassing state-of-the-art methods on several datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2605_15519
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle DiffVAS: Diffusion-Guided Visual Active Search in Partially Observable Environments
Sarkar, Anindya
Sastry, Srikumar
Pirinen, Aleksis
Jacobs, Nathan
Vorobeychik, Yevgeniy
Computer Vision and Pattern Recognition
Artificial Intelligence
Visual active search (VAS) has been introduced as a modeling framework that leverages visual cues to direct aerial (e.g., UAV-based) exploration and pinpoint areas of interest within extensive geospatial regions. Potential applications of VAS include detecting hotspots for rare wildlife poaching, aiding search-and-rescue missions, and uncovering illegal trafficking of weapons, among other uses. Previous VAS approaches assume that the entire search space is known upfront, which is often unrealistic due to constraints such as a restricted field of view and high acquisition costs, and they typically learn policies tailored to specific target objects, which limits their ability to search for multiple target categories simultaneously. In this work, we propose DiffVAS, a target-conditioned policy that searches for diverse objects simultaneously according to task requirements in partially observable environments, which advances the deployment of visual active search policies in real-world applications. DiffVAS leverages a diffusion model to reconstruct the entire geospatial area from sequentially observed partial glimpses, which enables a target-conditioned reinforcement learning-based planning module to effectively reason and guide subsequent search steps. Extensive experiments demonstrate that DiffVAS excels in searching diverse objects in partially observable environments, significantly surpassing state-of-the-art methods on several datasets.
title DiffVAS: Diffusion-Guided Visual Active Search in Partially Observable Environments
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2605.15519