Learning Visual Information Utility with PIXER

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Turkar, Yash, Chase Jr, Timothy, Aluckal, Christo, Dantu, Karthik
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909320611889152
author Turkar, Yash
Chase Jr, Timothy
Aluckal, Christo
Dantu, Karthik
author_facet Turkar, Yash
Chase Jr, Timothy
Aluckal, Christo
Dantu, Karthik
contents Accurate feature detection is fundamental for various computer vision tasks, including autonomous robotics, 3D reconstruction, medical imaging, and remote sensing. Despite advancements in enhancing the robustness of visual features, no existing method measures the utility of visual information before processing by specific feature-type algorithms. To address this gap, we introduce PIXER and the concept of "Featureness," which reflects the inherent interest and reliability of visual information for robust recognition, independent of any specific feature type. Leveraging a generalization on Bayesian learning, our approach quantifies both the probability and uncertainty of a pixel's contribution to robust visual utility in a single-shot process, avoiding costly operations such as Monte Carlo sampling and permitting customizable featureness definitions adaptable to a wide range of applications. We evaluate PIXER on visual odometry with featureness selectivity, achieving an average of 31% improvement in RMSE trajectory with 49% fewer features.
format Preprint
id arxiv_https___arxiv_org_abs_2409_13151
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Learning Visual Information Utility with PIXER
Turkar, Yash
Chase Jr, Timothy
Aluckal, Christo
Dantu, Karthik
Computer Vision and Pattern Recognition
Robotics
Accurate feature detection is fundamental for various computer vision tasks, including autonomous robotics, 3D reconstruction, medical imaging, and remote sensing. Despite advancements in enhancing the robustness of visual features, no existing method measures the utility of visual information before processing by specific feature-type algorithms. To address this gap, we introduce PIXER and the concept of "Featureness," which reflects the inherent interest and reliability of visual information for robust recognition, independent of any specific feature type. Leveraging a generalization on Bayesian learning, our approach quantifies both the probability and uncertainty of a pixel's contribution to robust visual utility in a single-shot process, avoiding costly operations such as Monte Carlo sampling and permitting customizable featureness definitions adaptable to a wide range of applications. We evaluate PIXER on visual odometry with featureness selectivity, achieving an average of 31% improvement in RMSE trajectory with 49% fewer features.
title Learning Visual Information Utility with PIXER
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2409.13151