Constrained Human-AI Cooperation: An Inclusive Embodied Social Intelligence Challenge
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908404699627520 |
|---|---|
| author | Du, Weihua Lyu, Qiushi Shan, Jiaming Qi, Zhenting Zhang, Hongxin Chen, Sunli Peng, Andi Shu, Tianmin Lee, Kwonjoon Dariush, Behzad Gan, Chuang |
| author_facet | Du, Weihua Lyu, Qiushi Shan, Jiaming Qi, Zhenting Zhang, Hongxin Chen, Sunli Peng, Andi Shu, Tianmin Lee, Kwonjoon Dariush, Behzad Gan, Chuang |
| contents | We introduce Constrained Human-AI Cooperation (CHAIC), an inclusive embodied social intelligence challenge designed to test social perception and cooperation in embodied agents. In CHAIC, the goal is for an embodied agent equipped with egocentric observations to assist a human who may be operating under physical constraints -- e.g., unable to reach high places or confined to a wheelchair -- in performing common household or outdoor tasks as efficiently as possible. To achieve this, a successful helper must: (1) infer the human's intents and constraints by following the human and observing their behaviors (social perception), and (2) make a cooperative plan tailored to the human partner to solve the task as quickly as possible, working together as a team (cooperative planning). To benchmark this challenge, we create four new agents with real physical constraints and eight long-horizon tasks featuring both indoor and outdoor scenes with various constraints, emergency events, and potential risks. We benchmark planning- and learning-based baselines on the challenge and introduce a new method that leverages large language models and behavior modeling. Empirical evaluations demonstrate the effectiveness of our benchmark in enabling systematic assessment of key aspects of machine social intelligence. Our benchmark and code are publicly available at https://github.com/UMass-Embodied-AGI/CHAIC. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_01796 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Constrained Human-AI Cooperation: An Inclusive Embodied Social Intelligence Challenge Du, Weihua Lyu, Qiushi Shan, Jiaming Qi, Zhenting Zhang, Hongxin Chen, Sunli Peng, Andi Shu, Tianmin Lee, Kwonjoon Dariush, Behzad Gan, Chuang Artificial Intelligence Human-Computer Interaction Robotics We introduce Constrained Human-AI Cooperation (CHAIC), an inclusive embodied social intelligence challenge designed to test social perception and cooperation in embodied agents. In CHAIC, the goal is for an embodied agent equipped with egocentric observations to assist a human who may be operating under physical constraints -- e.g., unable to reach high places or confined to a wheelchair -- in performing common household or outdoor tasks as efficiently as possible. To achieve this, a successful helper must: (1) infer the human's intents and constraints by following the human and observing their behaviors (social perception), and (2) make a cooperative plan tailored to the human partner to solve the task as quickly as possible, working together as a team (cooperative planning). To benchmark this challenge, we create four new agents with real physical constraints and eight long-horizon tasks featuring both indoor and outdoor scenes with various constraints, emergency events, and potential risks. We benchmark planning- and learning-based baselines on the challenge and introduce a new method that leverages large language models and behavior modeling. Empirical evaluations demonstrate the effectiveness of our benchmark in enabling systematic assessment of key aspects of machine social intelligence. Our benchmark and code are publicly available at https://github.com/UMass-Embodied-AGI/CHAIC. |
| title | Constrained Human-AI Cooperation: An Inclusive Embodied Social Intelligence Challenge |
| topic | Artificial Intelligence Human-Computer Interaction Robotics |
| url | https://arxiv.org/abs/2411.01796 |