Objectness Similarity: Capturing Object-Level Fidelity in 3D Scene Evaluation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Uchida, Yuiko, Togo, Ren, Maeda, Keisuke, Ogawa, Takahiro, Haseyama, Miki
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912581947490304
author Uchida, Yuiko
Togo, Ren
Maeda, Keisuke
Ogawa, Takahiro
Haseyama, Miki
author_facet Uchida, Yuiko
Togo, Ren
Maeda, Keisuke
Ogawa, Takahiro
Haseyama, Miki
contents This paper presents Objectness SIMilarity (OSIM), a novel evaluation metric for 3D scenes that explicitly focuses on "objects," which are fundamental units of human visual perception. Existing metrics assess overall image quality, leading to discrepancies with human perception. Inspired by neuropsychological insights, we hypothesize that human recognition of 3D scenes fundamentally involves attention to individual objects. OSIM enables object-centric evaluations by leveraging an object detection model and its feature representations to quantify the "objectness" of each object in the scene. Our user study demonstrates that OSIM aligns more closely with human perception compared to existing metrics. We also analyze the characteristics of OSIM using various approaches. Moreover, we re-evaluate recent 3D reconstruction and generation models under a standardized experimental setup to clarify advancements in this field. The code is available at https://github.com/Objectness-Similarity/OSIM.
format Preprint
id arxiv_https___arxiv_org_abs_2509_09143
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Objectness Similarity: Capturing Object-Level Fidelity in 3D Scene Evaluation
Uchida, Yuiko
Togo, Ren
Maeda, Keisuke
Ogawa, Takahiro
Haseyama, Miki
Computer Vision and Pattern Recognition
Artificial Intelligence
Graphics
This paper presents Objectness SIMilarity (OSIM), a novel evaluation metric for 3D scenes that explicitly focuses on "objects," which are fundamental units of human visual perception. Existing metrics assess overall image quality, leading to discrepancies with human perception. Inspired by neuropsychological insights, we hypothesize that human recognition of 3D scenes fundamentally involves attention to individual objects. OSIM enables object-centric evaluations by leveraging an object detection model and its feature representations to quantify the "objectness" of each object in the scene. Our user study demonstrates that OSIM aligns more closely with human perception compared to existing metrics. We also analyze the characteristics of OSIM using various approaches. Moreover, we re-evaluate recent 3D reconstruction and generation models under a standardized experimental setup to clarify advancements in this field. The code is available at https://github.com/Objectness-Similarity/OSIM.
title Objectness Similarity: Capturing Object-Level Fidelity in 3D Scene Evaluation
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Graphics
url https://arxiv.org/abs/2509.09143