Active View Selector: Fast and Accurate Active View Selection with Cross Reference Image Quality Assessment

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Zirui, Bhalgat, Yash, Li, Ruining, Prisacariu, Victor Adrian
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908419808559104
author Wang, Zirui
Bhalgat, Yash
Li, Ruining
Prisacariu, Victor Adrian
author_facet Wang, Zirui
Bhalgat, Yash
Li, Ruining
Prisacariu, Victor Adrian
contents We tackle active view selection in novel view synthesis and 3D reconstruction. Existing methods like FisheRF and ActiveNeRF select the next best view by minimizing uncertainty or maximizing information gain in 3D, but they require specialized designs for different 3D representations and involve complex modelling in 3D space. Instead, we reframe this as a 2D image quality assessment (IQA) task, selecting views where current renderings have the lowest quality. Since ground-truth images for candidate views are unavailable, full-reference metrics like PSNR and SSIM are inapplicable, while no-reference metrics, such as MUSIQ and MANIQA, lack the essential multi-view context. Inspired by a recent cross-referencing quality framework CrossScore, we train a model to predict SSIM within a multi-view setup and use it to guide view selection. Our cross-reference IQA framework achieves substantial quantitative and qualitative improvements across standard benchmarks, while being agnostic to 3D representations, and runs 14-33 times faster than previous methods.
format Preprint
id arxiv_https___arxiv_org_abs_2506_19844
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Active View Selector: Fast and Accurate Active View Selection with Cross Reference Image Quality Assessment
Wang, Zirui
Bhalgat, Yash
Li, Ruining
Prisacariu, Victor Adrian
Computer Vision and Pattern Recognition
We tackle active view selection in novel view synthesis and 3D reconstruction. Existing methods like FisheRF and ActiveNeRF select the next best view by minimizing uncertainty or maximizing information gain in 3D, but they require specialized designs for different 3D representations and involve complex modelling in 3D space. Instead, we reframe this as a 2D image quality assessment (IQA) task, selecting views where current renderings have the lowest quality. Since ground-truth images for candidate views are unavailable, full-reference metrics like PSNR and SSIM are inapplicable, while no-reference metrics, such as MUSIQ and MANIQA, lack the essential multi-view context. Inspired by a recent cross-referencing quality framework CrossScore, we train a model to predict SSIM within a multi-view setup and use it to guide view selection. Our cross-reference IQA framework achieves substantial quantitative and qualitative improvements across standard benchmarks, while being agnostic to 3D representations, and runs 14-33 times faster than previous methods.
title Active View Selector: Fast and Accurate Active View Selection with Cross Reference Image Quality Assessment
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.19844