EgoPet: Egomotion and Interaction Data from an Animal's Perspective
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913315776626688 |
|---|---|
| author | Bar, Amir Bakhtiar, Arya Tran, Danny Loquercio, Antonio Rajasegaran, Jathushan LeCun, Yann Globerson, Amir Darrell, Trevor |
| author_facet | Bar, Amir Bakhtiar, Arya Tran, Danny Loquercio, Antonio Rajasegaran, Jathushan LeCun, Yann Globerson, Amir Darrell, Trevor |
| contents | Animals perceive the world to plan their actions and interact with other agents to accomplish complex tasks, demonstrating capabilities that are still unmatched by AI systems. To advance our understanding and reduce the gap between the capabilities of animals and AI systems, we introduce a dataset of pet egomotion imagery with diverse examples of simultaneous egomotion and multi-agent interaction. Current video datasets separately contain egomotion and interaction examples, but rarely both at the same time. In addition, EgoPet offers a radically distinct perspective from existing egocentric datasets of humans or vehicles. We define two in-domain benchmark tasks that capture animal behavior, and a third benchmark to assess the utility of EgoPet as a pretraining resource to robotic quadruped locomotion, showing that models trained from EgoPet outperform those trained from prior datasets. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_09991 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | EgoPet: Egomotion and Interaction Data from an Animal's Perspective Bar, Amir Bakhtiar, Arya Tran, Danny Loquercio, Antonio Rajasegaran, Jathushan LeCun, Yann Globerson, Amir Darrell, Trevor Robotics Computer Vision and Pattern Recognition Animals perceive the world to plan their actions and interact with other agents to accomplish complex tasks, demonstrating capabilities that are still unmatched by AI systems. To advance our understanding and reduce the gap between the capabilities of animals and AI systems, we introduce a dataset of pet egomotion imagery with diverse examples of simultaneous egomotion and multi-agent interaction. Current video datasets separately contain egomotion and interaction examples, but rarely both at the same time. In addition, EgoPet offers a radically distinct perspective from existing egocentric datasets of humans or vehicles. We define two in-domain benchmark tasks that capture animal behavior, and a third benchmark to assess the utility of EgoPet as a pretraining resource to robotic quadruped locomotion, showing that models trained from EgoPet outperform those trained from prior datasets. |
| title | EgoPet: Egomotion and Interaction Data from an Animal's Perspective |
| topic | Robotics Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2404.09991 |