Saved in:
Bibliographic Details
Main Authors: Liang, Xiaoyu, Liu, Ziang, Lin, Kelvin, Gu, Edward, Ye, Ruolin, Nguyen, Tam, Hsu, Cynthia, Wu, Zhanxin, Yang, Xiaoman, Cheung, Christy Sum Yu, Soh, Harold, Dimitropoulou, Katherine, Bhattacharjee, Tapomayukh
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2511.13707
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917085830971392
author Liang, Xiaoyu
Liu, Ziang
Lin, Kelvin
Gu, Edward
Ye, Ruolin
Nguyen, Tam
Hsu, Cynthia
Wu, Zhanxin
Yang, Xiaoman
Cheung, Christy Sum Yu
Soh, Harold
Dimitropoulou, Katherine
Bhattacharjee, Tapomayukh
author_facet Liang, Xiaoyu
Liu, Ziang
Lin, Kelvin
Gu, Edward
Ye, Ruolin
Nguyen, Tam
Hsu, Cynthia
Wu, Zhanxin
Yang, Xiaoman
Cheung, Christy Sum Yu
Soh, Harold
Dimitropoulou, Katherine
Bhattacharjee, Tapomayukh
contents We present OpenRoboCare, a multimodal dataset for robot caregiving, capturing expert occupational therapist demonstrations of Activities of Daily Living (ADLs). Caregiving tasks involve complex physical human-robot interactions, requiring precise perception under occlusions, safe physical contact, and long-horizon planning. While recent advances in robot learning from demonstrations have shown promise, there is a lack of a large-scale, diverse, and expert-driven dataset that captures real-world caregiving routines. To address this gap, we collect data from 21 occupational therapists performing 15 ADL tasks on two manikins. The dataset spans five modalities: RGB-D video, pose tracking, eye-gaze tracking, task and action annotations, and tactile sensing, providing rich multimodal insights into caregiver movement, attention, force application, and task execution strategies. We further analyze expert caregiving principles and strategies, offering insights to improve robot efficiency and task feasibility. Additionally, our evaluations demonstrate that OpenRoboCare presents challenges for state-of-the-art robot perception and human activity recognition methods, both critical for developing safe and adaptive assistive robots, highlighting the value of our contribution. See our website for additional visualizations: https://emprise.cs.cornell.edu/robo-care/.
format Preprint
id arxiv_https___arxiv_org_abs_2511_13707
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle OpenRoboCare: A Multimodal Multi-Task Expert Demonstration Dataset for Robot Caregiving
Liang, Xiaoyu
Liu, Ziang
Lin, Kelvin
Gu, Edward
Ye, Ruolin
Nguyen, Tam
Hsu, Cynthia
Wu, Zhanxin
Yang, Xiaoman
Cheung, Christy Sum Yu
Soh, Harold
Dimitropoulou, Katherine
Bhattacharjee, Tapomayukh
Robotics
We present OpenRoboCare, a multimodal dataset for robot caregiving, capturing expert occupational therapist demonstrations of Activities of Daily Living (ADLs). Caregiving tasks involve complex physical human-robot interactions, requiring precise perception under occlusions, safe physical contact, and long-horizon planning. While recent advances in robot learning from demonstrations have shown promise, there is a lack of a large-scale, diverse, and expert-driven dataset that captures real-world caregiving routines. To address this gap, we collect data from 21 occupational therapists performing 15 ADL tasks on two manikins. The dataset spans five modalities: RGB-D video, pose tracking, eye-gaze tracking, task and action annotations, and tactile sensing, providing rich multimodal insights into caregiver movement, attention, force application, and task execution strategies. We further analyze expert caregiving principles and strategies, offering insights to improve robot efficiency and task feasibility. Additionally, our evaluations demonstrate that OpenRoboCare presents challenges for state-of-the-art robot perception and human activity recognition methods, both critical for developing safe and adaptive assistive robots, highlighting the value of our contribution. See our website for additional visualizations: https://emprise.cs.cornell.edu/robo-care/.
title OpenRoboCare: A Multimodal Multi-Task Expert Demonstration Dataset for Robot Caregiving
topic Robotics
url https://arxiv.org/abs/2511.13707