Can VLA Models Learn from Real-World Data Continually without Forgetting?

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhu, Jiarun, Hong, Yijun, Sun, Xiaoquan, Xu, Zetian, Yuan, Mingqi, Wang, Zhiyong, Zeng, Wenjun, Chen, Jiayu
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911719720222720
author Zhu, Jiarun
Hong, Yijun
Sun, Xiaoquan
Xu, Zetian
Yuan, Mingqi
Wang, Zhiyong
Zeng, Wenjun
Chen, Jiayu
author_facet Zhu, Jiarun
Hong, Yijun
Sun, Xiaoquan
Xu, Zetian
Yuan, Mingqi
Wang, Zhiyong
Zeng, Wenjun
Chen, Jiayu
contents Vision-language-action (VLA) models provide a promising foundation for general-purpose robotics. However, their successful deployment in real-world scenarios requires the ability to continually acquire new skills while retaining previously learned behaviors. While pioneering research has studied the continual learning of VLA models in narrowly simulated environments, this challenge remains largely unexplored under realistic conditions. To address this limitation, we construct a real-world continual learning dataset comprising four sequential manipulation tasks, spanning rigid-object pick-and-place, contact-rich pressing, and deformable-object folding. Using this dataset, we conduct comprehensive experiments and find that VLA models suffer significant catastrophic forgetting when continually learning from heterogeneous real-world demonstrations. We then systematically evaluate experience replay and uncover key implementation factors that govern its success. In summary, this work provides the first empirical study of real-world continual VLA learning and offers practical guidance for deploying long-lived robot policies.
format Preprint
id arxiv_https___arxiv_org_abs_2605_26820
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Can VLA Models Learn from Real-World Data Continually without Forgetting?
Zhu, Jiarun
Hong, Yijun
Sun, Xiaoquan
Xu, Zetian
Yuan, Mingqi
Wang, Zhiyong
Zeng, Wenjun
Chen, Jiayu
Robotics
Vision-language-action (VLA) models provide a promising foundation for general-purpose robotics. However, their successful deployment in real-world scenarios requires the ability to continually acquire new skills while retaining previously learned behaviors. While pioneering research has studied the continual learning of VLA models in narrowly simulated environments, this challenge remains largely unexplored under realistic conditions. To address this limitation, we construct a real-world continual learning dataset comprising four sequential manipulation tasks, spanning rigid-object pick-and-place, contact-rich pressing, and deformable-object folding. Using this dataset, we conduct comprehensive experiments and find that VLA models suffer significant catastrophic forgetting when continually learning from heterogeneous real-world demonstrations. We then systematically evaluate experience replay and uncover key implementation factors that govern its success. In summary, this work provides the first empirical study of real-world continual VLA learning and offers practical guidance for deploying long-lived robot policies.
title Can VLA Models Learn from Real-World Data Continually without Forgetting?
topic Robotics
url https://arxiv.org/abs/2605.26820