Saved in:
Bibliographic Details
Main Authors: Surendran, Vidullan, Wagner, Alan R.
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2410.20256
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916456210366464
author Surendran, Vidullan
Wagner, Alan R.
author_facet Surendran, Vidullan
Wagner, Alan R.
contents Recognising intent in collaborative human robot tasks can improve team performance and human perception of robots. Intent can differ from the observed outcome in the presence of mistakes which are likely in physically dynamic tasks. We created a dataset of 1227 throws of a ball at a target from 10 participants and observed that 47% of throws were mistakes with 16% completely missing the target. Our research leverages facial images capturing the person's reaction to the outcome of a throw to predict when the resulting throw is a mistake and then we determine the actual intent of the throw. The approach we propose for outcome prediction performs 38% better than the two-stream architecture used previously for this task on front-on videos. In addition, we propose a 1-D CNN model which is used in conjunction with priors learned from the frequency of mistakes to provide an end-to-end pipeline for outcome and intent recognition in this throwing task.
format Preprint
id arxiv_https___arxiv_org_abs_2410_20256
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle That was not what I was aiming at! Differentiating human intent and outcome in a physically dynamic throwing task
Surendran, Vidullan
Wagner, Alan R.
Robotics
Human-Computer Interaction
Recognising intent in collaborative human robot tasks can improve team performance and human perception of robots. Intent can differ from the observed outcome in the presence of mistakes which are likely in physically dynamic tasks. We created a dataset of 1227 throws of a ball at a target from 10 participants and observed that 47% of throws were mistakes with 16% completely missing the target. Our research leverages facial images capturing the person's reaction to the outcome of a throw to predict when the resulting throw is a mistake and then we determine the actual intent of the throw. The approach we propose for outcome prediction performs 38% better than the two-stream architecture used previously for this task on front-on videos. In addition, we propose a 1-D CNN model which is used in conjunction with priors learned from the frequency of mistakes to provide an end-to-end pipeline for outcome and intent recognition in this throwing task.
title That was not what I was aiming at! Differentiating human intent and outcome in a physically dynamic throwing task
topic Robotics
Human-Computer Interaction
url https://arxiv.org/abs/2410.20256