Task-agnostic Lifelong Robot Learning with Retrieval-based Weighted Local Adaptation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912585121529856 |
|---|---|
| author | Yang, Pengzhi Wang, Xinyu Zhang, Ruipeng Wang, Cong Oliehoek, Frans A. Kober, Jens |
| author_facet | Yang, Pengzhi Wang, Xinyu Zhang, Ruipeng Wang, Cong Oliehoek, Frans A. Kober, Jens |
| contents | A fundamental objective in intelligent robotics is to move towards lifelong learning robot that can learn and adapt to unseen scenarios over time. However, continually learning new tasks would introduce catastrophic forgetting problems due to data distribution shifts. To mitigate this, we store a subset of data from previous tasks and utilize it in two manners: leveraging experience replay to retain learned skills and applying a novel Retrieval-based Local Adaptation technique to restore relevant knowledge. Since a lifelong learning robot must operate in task-free scenarios, where task IDs and even boundaries are not available, our method performs effectively without relying on such information. We also incorporate a selective weighting mechanism to focus on the most "forgotten" skill segment, ensuring effective knowledge restoration. Experimental results across diverse manipulation tasks demonstrate that our framework provides a scalable paradigm for lifelong learning, enhancing robot performance in open-ended, task-free scenarios. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_02995 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Task-agnostic Lifelong Robot Learning with Retrieval-based Weighted Local Adaptation Yang, Pengzhi Wang, Xinyu Zhang, Ruipeng Wang, Cong Oliehoek, Frans A. Kober, Jens Robotics Artificial Intelligence A fundamental objective in intelligent robotics is to move towards lifelong learning robot that can learn and adapt to unseen scenarios over time. However, continually learning new tasks would introduce catastrophic forgetting problems due to data distribution shifts. To mitigate this, we store a subset of data from previous tasks and utilize it in two manners: leveraging experience replay to retain learned skills and applying a novel Retrieval-based Local Adaptation technique to restore relevant knowledge. Since a lifelong learning robot must operate in task-free scenarios, where task IDs and even boundaries are not available, our method performs effectively without relying on such information. We also incorporate a selective weighting mechanism to focus on the most "forgotten" skill segment, ensuring effective knowledge restoration. Experimental results across diverse manipulation tasks demonstrate that our framework provides a scalable paradigm for lifelong learning, enhancing robot performance in open-ended, task-free scenarios. |
| title | Task-agnostic Lifelong Robot Learning with Retrieval-based Weighted Local Adaptation |
| topic | Robotics Artificial Intelligence |
| url | https://arxiv.org/abs/2410.02995 |