HAPI: A Model for Learning Robot Facial Expressions from Human Preferences

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yang, Dongsheng, Liu, Qianying, Sato, Wataru, Minato, Takashi, Liu, Chaoran, Nishida, Shin'ya
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908430938144768
author Yang, Dongsheng
Liu, Qianying
Sato, Wataru
Minato, Takashi
Liu, Chaoran
Nishida, Shin'ya
author_facet Yang, Dongsheng
Liu, Qianying
Sato, Wataru
Minato, Takashi
Liu, Chaoran
Nishida, Shin'ya
contents Automatic robotic facial expression generation is crucial for human-robot interaction, as handcrafted methods based on fixed joint configurations often yield rigid and unnatural behaviors. Although recent automated techniques reduce the need for manual tuning, they tend to fall short by not adequately bridging the gap between human preferences and model predictions-resulting in a deficiency of nuanced and realistic expressions due to limited degrees of freedom and insufficient perceptual integration. In this work, we propose a novel learning-to-rank framework that leverages human feedback to address this discrepancy and enhanced the expressiveness of robotic faces. Specifically, we conduct pairwise comparison annotations to collect human preference data and develop the Human Affective Pairwise Impressions (HAPI) model, a Siamese RankNet-based approach that refines expression evaluation. Results obtained via Bayesian Optimization and online expression survey on a 35-DOF android platform demonstrate that our approach produces significantly more realistic and socially resonant expressions of Anger, Happiness, and Surprise than those generated by baseline and expert-designed methods. This confirms that our framework effectively bridges the gap between human preferences and model predictions while robustly aligning robotic expression generation with human affective responses.
format Preprint
id arxiv_https___arxiv_org_abs_2503_17046
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle HAPI: A Model for Learning Robot Facial Expressions from Human Preferences
Yang, Dongsheng
Liu, Qianying
Sato, Wataru
Minato, Takashi
Liu, Chaoran
Nishida, Shin'ya
Robotics
Artificial Intelligence
Computer Vision and Pattern Recognition
Human-Computer Interaction
Machine Learning
Automatic robotic facial expression generation is crucial for human-robot interaction, as handcrafted methods based on fixed joint configurations often yield rigid and unnatural behaviors. Although recent automated techniques reduce the need for manual tuning, they tend to fall short by not adequately bridging the gap between human preferences and model predictions-resulting in a deficiency of nuanced and realistic expressions due to limited degrees of freedom and insufficient perceptual integration. In this work, we propose a novel learning-to-rank framework that leverages human feedback to address this discrepancy and enhanced the expressiveness of robotic faces. Specifically, we conduct pairwise comparison annotations to collect human preference data and develop the Human Affective Pairwise Impressions (HAPI) model, a Siamese RankNet-based approach that refines expression evaluation. Results obtained via Bayesian Optimization and online expression survey on a 35-DOF android platform demonstrate that our approach produces significantly more realistic and socially resonant expressions of Anger, Happiness, and Surprise than those generated by baseline and expert-designed methods. This confirms that our framework effectively bridges the gap between human preferences and model predictions while robustly aligning robotic expression generation with human affective responses.
title HAPI: A Model for Learning Robot Facial Expressions from Human Preferences
topic Robotics
Artificial Intelligence
Computer Vision and Pattern Recognition
Human-Computer Interaction
Machine Learning
url https://arxiv.org/abs/2503.17046