HHI-Assist: A Dataset and Benchmark of Human-Human Interaction in Physical Assistance Scenario

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Saadatnejad, Saeed, Hosseininejad, Reyhaneh, Barreiros, Jose, Tsui, Katherine M., Alahi, Alexandre
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912584767111168
author Saadatnejad, Saeed
Hosseininejad, Reyhaneh
Barreiros, Jose
Tsui, Katherine M.
Alahi, Alexandre
author_facet Saadatnejad, Saeed
Hosseininejad, Reyhaneh
Barreiros, Jose
Tsui, Katherine M.
Alahi, Alexandre
contents The increasing labor shortage and aging population underline the need for assistive robots to support human care recipients. To enable safe and responsive assistance, robots require accurate human motion prediction in physical interaction scenarios. However, this remains a challenging task due to the variability of assistive settings and the complexity of coupled dynamics in physical interactions. In this work, we address these challenges through two key contributions: (1) HHI-Assist, a dataset comprising motion capture clips of human-human interactions in assistive tasks; and (2) a conditional Transformer-based denoising diffusion model for predicting the poses of interacting agents. Our model effectively captures the coupled dynamics between caregivers and care receivers, demonstrating improvements over baselines and strong generalization to unseen scenarios. By advancing interaction-aware motion prediction and introducing a new dataset, our work has the potential to significantly enhance robotic assistance policies. The dataset and code are available at: https://sites.google.com/view/hhi-assist/home
format Preprint
id arxiv_https___arxiv_org_abs_2509_10096
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle HHI-Assist: A Dataset and Benchmark of Human-Human Interaction in Physical Assistance Scenario
Saadatnejad, Saeed
Hosseininejad, Reyhaneh
Barreiros, Jose
Tsui, Katherine M.
Alahi, Alexandre
Robotics
Computer Vision and Pattern Recognition
The increasing labor shortage and aging population underline the need for assistive robots to support human care recipients. To enable safe and responsive assistance, robots require accurate human motion prediction in physical interaction scenarios. However, this remains a challenging task due to the variability of assistive settings and the complexity of coupled dynamics in physical interactions. In this work, we address these challenges through two key contributions: (1) HHI-Assist, a dataset comprising motion capture clips of human-human interactions in assistive tasks; and (2) a conditional Transformer-based denoising diffusion model for predicting the poses of interacting agents. Our model effectively captures the coupled dynamics between caregivers and care receivers, demonstrating improvements over baselines and strong generalization to unseen scenarios. By advancing interaction-aware motion prediction and introducing a new dataset, our work has the potential to significantly enhance robotic assistance policies. The dataset and code are available at: https://sites.google.com/view/hhi-assist/home
title HHI-Assist: A Dataset and Benchmark of Human-Human Interaction in Physical Assistance Scenario
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.10096