IA-MVS: Instance-Focused Adaptive Depth Sampling for Multi-View Stereo

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wang, Yinzhe, Xiao, Yiwen, Wang, Hu, Xu, Yiping, Tian, Yan
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915291974336512
author Wang, Yinzhe
Xiao, Yiwen
Wang, Hu
Xu, Yiping
Tian, Yan
author_facet Wang, Yinzhe
Xiao, Yiwen
Wang, Hu
Xu, Yiping
Tian, Yan
contents Multi-view stereo (MVS) models based on progressive depth hypothesis narrowing have made remarkable advancements. However, existing methods haven't fully utilized the potential that the depth coverage of individual instances is smaller than that of the entire scene, which restricts further improvements in depth estimation precision. Moreover, inevitable deviations in the initial stage accumulate as the process advances. In this paper, we propose Instance-Adaptive MVS (IA-MVS). It enhances the precision of depth estimation by narrowing the depth hypothesis range and conducting refinement on each instance. Additionally, a filtering mechanism based on intra-instance depth continuity priors is incorporated to boost robustness. Furthermore, recognizing that existing confidence estimation can degrade IA-MVS performance on point clouds. We have developed a detailed mathematical model for confidence estimation based on conditional probability. The proposed method can be widely applied in models based on MVSNet without imposing extra training burdens. Our method achieves state-of-the-art performance on the DTU benchmark. The source code is available at https://github.com/KevinWang73106/IA-MVS.
format Preprint
id arxiv_https___arxiv_org_abs_2505_12714
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle IA-MVS: Instance-Focused Adaptive Depth Sampling for Multi-View Stereo
Wang, Yinzhe
Xiao, Yiwen
Wang, Hu
Xu, Yiping
Tian, Yan
Computer Vision and Pattern Recognition
Multi-view stereo (MVS) models based on progressive depth hypothesis narrowing have made remarkable advancements. However, existing methods haven't fully utilized the potential that the depth coverage of individual instances is smaller than that of the entire scene, which restricts further improvements in depth estimation precision. Moreover, inevitable deviations in the initial stage accumulate as the process advances. In this paper, we propose Instance-Adaptive MVS (IA-MVS). It enhances the precision of depth estimation by narrowing the depth hypothesis range and conducting refinement on each instance. Additionally, a filtering mechanism based on intra-instance depth continuity priors is incorporated to boost robustness. Furthermore, recognizing that existing confidence estimation can degrade IA-MVS performance on point clouds. We have developed a detailed mathematical model for confidence estimation based on conditional probability. The proposed method can be widely applied in models based on MVSNet without imposing extra training burdens. Our method achieves state-of-the-art performance on the DTU benchmark. The source code is available at https://github.com/KevinWang73106/IA-MVS.
title IA-MVS: Instance-Focused Adaptive Depth Sampling for Multi-View Stereo
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.12714