Online Behavior Modification for Expressive User Control of RL-Trained Robots
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914929396678656 |
|---|---|
| author | Sheidlower, Isaac Murdock, Mavis Bethel, Emma Aronson, Reuben M. Short, Elaine Schaertl |
| author_facet | Sheidlower, Isaac Murdock, Mavis Bethel, Emma Aronson, Reuben M. Short, Elaine Schaertl |
| contents | Reinforcement Learning (RL) is an effective method for robots to learn tasks. However, in typical RL, end-users have little to no control over how the robot does the task after the robot has been deployed. To address this, we introduce the idea of online behavior modification, a paradigm in which users have control over behavior features of a robot in real time as it autonomously completes a task using an RL-trained policy. To show the value of this user-centered formulation for human-robot interaction, we present a behavior diversity based algorithm, Adjustable Control Of RL Dynamics (ACORD), and demonstrate its applicability to online behavior modification in simulation and a user study. In the study (n=23) users adjust the style of paintings as a robot traces a shape autonomously. We compare ACORD to RL and Shared Autonomy (SA), and show ACORD affords user-preferred levels of control and expression, comparable to SA, but with the potential for autonomous execution and robustness of RL. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_16776 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Online Behavior Modification for Expressive User Control of RL-Trained Robots Sheidlower, Isaac Murdock, Mavis Bethel, Emma Aronson, Reuben M. Short, Elaine Schaertl Robotics Artificial Intelligence Reinforcement Learning (RL) is an effective method for robots to learn tasks. However, in typical RL, end-users have little to no control over how the robot does the task after the robot has been deployed. To address this, we introduce the idea of online behavior modification, a paradigm in which users have control over behavior features of a robot in real time as it autonomously completes a task using an RL-trained policy. To show the value of this user-centered formulation for human-robot interaction, we present a behavior diversity based algorithm, Adjustable Control Of RL Dynamics (ACORD), and demonstrate its applicability to online behavior modification in simulation and a user study. In the study (n=23) users adjust the style of paintings as a robot traces a shape autonomously. We compare ACORD to RL and Shared Autonomy (SA), and show ACORD affords user-preferred levels of control and expression, comparable to SA, but with the potential for autonomous execution and robustness of RL. |
| title | Online Behavior Modification for Expressive User Control of RL-Trained Robots |
| topic | Robotics Artificial Intelligence |
| url | https://arxiv.org/abs/2408.16776 |