Visual Affordance Prediction: Survey and Reproducibility

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Apicella, Tommaso, Xompero, Alessio, Cavallaro, Andrea
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917010258001920
author Apicella, Tommaso
Xompero, Alessio
Cavallaro, Andrea
author_facet Apicella, Tommaso
Xompero, Alessio
Cavallaro, Andrea
contents Affordances are the potential actions an agent can perform on an object, as observed by a camera. Visual affordance prediction is formulated differently for tasks such as grasping detection, affordance classification, affordance segmentation, and hand pose estimation. This diversity in formulations leads to inconsistent definitions that prevent fair comparisons between methods. In this paper, we propose a unified formulation of visual affordance prediction by accounting for the complete information on the objects of interest and the interaction of the agent with the objects to accomplish a task. This unified formulation allows us to comprehensively and systematically review disparate visual affordance works, highlighting strengths and limitations of both methods and datasets. We also discuss reproducibility issues, such as the unavailability of methods implementation and experimental setups details, making benchmarks for visual affordance prediction unfair and unreliable. To favour transparency, we introduce the Affordance Sheet, a document that details the solution, datasets, and validation of a method, supporting future reproducibility and fairness in the community.
format Preprint
id arxiv_https___arxiv_org_abs_2505_05074
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Visual Affordance Prediction: Survey and Reproducibility
Apicella, Tommaso
Xompero, Alessio
Cavallaro, Andrea
Computer Vision and Pattern Recognition
Robotics
Affordances are the potential actions an agent can perform on an object, as observed by a camera. Visual affordance prediction is formulated differently for tasks such as grasping detection, affordance classification, affordance segmentation, and hand pose estimation. This diversity in formulations leads to inconsistent definitions that prevent fair comparisons between methods. In this paper, we propose a unified formulation of visual affordance prediction by accounting for the complete information on the objects of interest and the interaction of the agent with the objects to accomplish a task. This unified formulation allows us to comprehensively and systematically review disparate visual affordance works, highlighting strengths and limitations of both methods and datasets. We also discuss reproducibility issues, such as the unavailability of methods implementation and experimental setups details, making benchmarks for visual affordance prediction unfair and unreliable. To favour transparency, we introduce the Affordance Sheet, a document that details the solution, datasets, and validation of a method, supporting future reproducibility and fairness in the community.
title Visual Affordance Prediction: Survey and Reproducibility
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2505.05074