The Wilhelm Tell Dataset of Affordance Demonstrations
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913956201758720 |
|---|---|
| author | Ringe, Rachel Pomarlan, Mihai Tsiogkas, Nikolaos De Giorgis, Stefano Hedblom, Maria Malaka, Rainer |
| author_facet | Ringe, Rachel Pomarlan, Mihai Tsiogkas, Nikolaos De Giorgis, Stefano Hedblom, Maria Malaka, Rainer |
| contents | Affordances - i.e. possibilities for action that an environment or objects in it provide - are important for robots operating in human environments to perceive. Existing approaches train such capabilities on annotated static images or shapes. This work presents a novel dataset for affordance learning of common household tasks. Unlike previous approaches, our dataset consists of video sequences demonstrating the tasks from first- and third-person perspectives, along with metadata about the affordances that are manifested in the task, and is aimed towards training perception systems to recognize affordance manifestations. The demonstrations were collected from several participants and in total record about seven hours of human activity. The variety of task performances also allows studying preparatory maneuvers that people may perform for a task, such as how they arrange their task space, which is also relevant for collaborative service robots. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_17401 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | The Wilhelm Tell Dataset of Affordance Demonstrations Ringe, Rachel Pomarlan, Mihai Tsiogkas, Nikolaos De Giorgis, Stefano Hedblom, Maria Malaka, Rainer Robotics Human-Computer Interaction Affordances - i.e. possibilities for action that an environment or objects in it provide - are important for robots operating in human environments to perceive. Existing approaches train such capabilities on annotated static images or shapes. This work presents a novel dataset for affordance learning of common household tasks. Unlike previous approaches, our dataset consists of video sequences demonstrating the tasks from first- and third-person perspectives, along with metadata about the affordances that are manifested in the task, and is aimed towards training perception systems to recognize affordance manifestations. The demonstrations were collected from several participants and in total record about seven hours of human activity. The variety of task performances also allows studying preparatory maneuvers that people may perform for a task, such as how they arrange their task space, which is also relevant for collaborative service robots. |
| title | The Wilhelm Tell Dataset of Affordance Demonstrations |
| topic | Robotics Human-Computer Interaction |
| url | https://arxiv.org/abs/2507.17401 |