Optimizing Neurorobot Policy under Limited Demonstration Data through Preference Regret
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914445335199744 |
|---|---|
| author | Nguyen, Viet Dung Song, Yuhang Nguyen, Anh Heard, Jamison Bailey, Reynold Ororbia, Alexander |
| author_facet | Nguyen, Viet Dung Song, Yuhang Nguyen, Anh Heard, Jamison Bailey, Reynold Ororbia, Alexander |
| contents | Robot reinforcement learning from demonstrations (RLfD) assumes that expert data is abundant; this is usually unrealistic in the real world given data scarcity as well as high collection cost. Furthermore, imitation learning algorithms assume that the data is independently and identically distributed, which ultimately results in poorer performance as gradual errors emerge and compound within test-time trajectories. We address these issues by introducing the "master your own expertise" (MYOE) framework, a self-imitation framework that enables robotic agents to learn complex behaviors from limited demonstration data samples. Inspired by human perception and action, we propose and design what we call the queryable mixture-of-preferences state space model (QMoP-SSM), which estimates the desired goal at every time step. These desired goals are used in computing the "preference regret", which is used to optimize the robot control policy. Our experiments demonstrate the robustness, adaptability, and out-of-sample performance of our agent compared to other state-of-the-art RLfD schemes. The GitHub repository that supports this work can be found at: https://github.com/rxng8/neurorobot-preference-regret-learning. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_03523 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Optimizing Neurorobot Policy under Limited Demonstration Data through Preference Regret Nguyen, Viet Dung Song, Yuhang Nguyen, Anh Heard, Jamison Bailey, Reynold Ororbia, Alexander Robotics Artificial Intelligence Computer Vision and Pattern Recognition Machine Learning I.2.9; I.2.10; G.3; I.2.6 Robot reinforcement learning from demonstrations (RLfD) assumes that expert data is abundant; this is usually unrealistic in the real world given data scarcity as well as high collection cost. Furthermore, imitation learning algorithms assume that the data is independently and identically distributed, which ultimately results in poorer performance as gradual errors emerge and compound within test-time trajectories. We address these issues by introducing the "master your own expertise" (MYOE) framework, a self-imitation framework that enables robotic agents to learn complex behaviors from limited demonstration data samples. Inspired by human perception and action, we propose and design what we call the queryable mixture-of-preferences state space model (QMoP-SSM), which estimates the desired goal at every time step. These desired goals are used in computing the "preference regret", which is used to optimize the robot control policy. Our experiments demonstrate the robustness, adaptability, and out-of-sample performance of our agent compared to other state-of-the-art RLfD schemes. The GitHub repository that supports this work can be found at: https://github.com/rxng8/neurorobot-preference-regret-learning. |
| title | Optimizing Neurorobot Policy under Limited Demonstration Data through Preference Regret |
| topic | Robotics Artificial Intelligence Computer Vision and Pattern Recognition Machine Learning I.2.9; I.2.10; G.3; I.2.6 |
| url | https://arxiv.org/abs/2604.03523 |