Upgrading Pepper Robot s Social Interaction with Advanced Hardware and Perception Enhancements
Fuente:
arXiv
Guardado en:
| Autores principales: | , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914932240416768 |
|---|---|
| author | Magri, Paolo Amirian, Javad Chetouani, Mohamed |
| author_facet | Magri, Paolo Amirian, Javad Chetouani, Mohamed |
| contents | In this paper, we propose hardware and software enhancements for the Pepper robot to improve its human-robot interaction capabilities. This includes the integration of an NVIDIA Jetson GPU to enhance computational capabilities and execute real time algorithms, and a RealSense D435i camera to capture depth images, as well as the computer vision algorithms to detect and localize the humans around the robot and estimate their body orientation and gaze direction. The new stack is implemented on ROS and is running on the extended Pepper hardware, and the communication with the robot s firmware is done through the NAOqi ROS driver API. We have also collected a MoCap dataset of human activities in a controlled environment, together with the corresponding RGB-D data, to validate the proposed perception algorithms. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_01036 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Upgrading Pepper Robot s Social Interaction with Advanced Hardware and Perception Enhancements Magri, Paolo Amirian, Javad Chetouani, Mohamed Robotics Systems and Control In this paper, we propose hardware and software enhancements for the Pepper robot to improve its human-robot interaction capabilities. This includes the integration of an NVIDIA Jetson GPU to enhance computational capabilities and execute real time algorithms, and a RealSense D435i camera to capture depth images, as well as the computer vision algorithms to detect and localize the humans around the robot and estimate their body orientation and gaze direction. The new stack is implemented on ROS and is running on the extended Pepper hardware, and the communication with the robot s firmware is done through the NAOqi ROS driver API. We have also collected a MoCap dataset of human activities in a controlled environment, together with the corresponding RGB-D data, to validate the proposed perception algorithms. |
| title | Upgrading Pepper Robot s Social Interaction with Advanced Hardware and Perception Enhancements |
| topic | Robotics Systems and Control |
| url | https://arxiv.org/abs/2409.01036 |