MaIL: Improving Imitation Learning with Mamba
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909395405766656 |
|---|---|
| author | Jia, Xiaogang Wang, Qian Donat, Atalay Xing, Bowen Li, Ge Zhou, Hongyi Celik, Onur Blessing, Denis Lioutikov, Rudolf Neumann, Gerhard |
| author_facet | Jia, Xiaogang Wang, Qian Donat, Atalay Xing, Bowen Li, Ge Zhou, Hongyi Celik, Onur Blessing, Denis Lioutikov, Rudolf Neumann, Gerhard |
| contents | This work presents Mamba Imitation Learning (MaIL), a novel imitation learning (IL) architecture that provides an alternative to state-of-the-art (SoTA) Transformer-based policies. MaIL leverages Mamba, a state-space model designed to selectively focus on key features of the data. While Transformers are highly effective in data-rich environments due to their dense attention mechanisms, they can struggle with smaller datasets, often leading to overfitting or suboptimal representation learning. In contrast, Mamba's architecture enhances representation learning efficiency by focusing on key features and reducing model complexity. This approach mitigates overfitting and enhances generalization, even when working with limited data. Extensive evaluations on the LIBERO benchmark demonstrate that MaIL consistently outperforms Transformers on all LIBERO tasks with limited data and matches their performance when the full dataset is available. Additionally, MaIL's effectiveness is validated through its superior performance in three real robot experiments. Our code is available at https://github.com/ALRhub/MaIL. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_08234 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | MaIL: Improving Imitation Learning with Mamba Jia, Xiaogang Wang, Qian Donat, Atalay Xing, Bowen Li, Ge Zhou, Hongyi Celik, Onur Blessing, Denis Lioutikov, Rudolf Neumann, Gerhard Machine Learning Robotics This work presents Mamba Imitation Learning (MaIL), a novel imitation learning (IL) architecture that provides an alternative to state-of-the-art (SoTA) Transformer-based policies. MaIL leverages Mamba, a state-space model designed to selectively focus on key features of the data. While Transformers are highly effective in data-rich environments due to their dense attention mechanisms, they can struggle with smaller datasets, often leading to overfitting or suboptimal representation learning. In contrast, Mamba's architecture enhances representation learning efficiency by focusing on key features and reducing model complexity. This approach mitigates overfitting and enhances generalization, even when working with limited data. Extensive evaluations on the LIBERO benchmark demonstrate that MaIL consistently outperforms Transformers on all LIBERO tasks with limited data and matches their performance when the full dataset is available. Additionally, MaIL's effectiveness is validated through its superior performance in three real robot experiments. Our code is available at https://github.com/ALRhub/MaIL. |
| title | MaIL: Improving Imitation Learning with Mamba |
| topic | Machine Learning Robotics |
| url | https://arxiv.org/abs/2406.08234 |