CARE: Multi-Task Pretraining for Latent Continuous Action Representation in Robot Control

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shi, Jiaqi, Zhang, Xulong, Qu, Xiaoyang, Wang, Jianzong
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908799082692608
author Shi, Jiaqi
Zhang, Xulong
Qu, Xiaoyang
Wang, Jianzong
author_facet Shi, Jiaqi
Zhang, Xulong
Qu, Xiaoyang
Wang, Jianzong
contents Recent advances in Vision-Language-Action (VLA) models have shown promise for robot control, but their dependence on action supervision limits scalability and generalization. To address this challenge, we introduce CARE, a novel framework designed to train VLA models for robotic task execution. Unlike existing methods that depend on action annotations during pretraining, CARE eliminates the need for explicit action labels by leveraging only video-text pairs. These weakly aligned data sources enable the model to learn continuous latent action representations through a newly designed multi-task pretraining objective. During fine-tuning, a small set of labeled data is used to train the action head for control. Experimental results across various simulation tasks demonstrate CARE's superior success rate, semantic interpretability, and ability to avoid shortcut learning. These results underscore CARE's scalability, interpretability, and effectiveness in robotic control with weak supervision.
format Preprint
id arxiv_https___arxiv_org_abs_2601_22467
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle CARE: Multi-Task Pretraining for Latent Continuous Action Representation in Robot Control
Shi, Jiaqi
Zhang, Xulong
Qu, Xiaoyang
Wang, Jianzong
Robotics
Computer Vision and Pattern Recognition
Recent advances in Vision-Language-Action (VLA) models have shown promise for robot control, but their dependence on action supervision limits scalability and generalization. To address this challenge, we introduce CARE, a novel framework designed to train VLA models for robotic task execution. Unlike existing methods that depend on action annotations during pretraining, CARE eliminates the need for explicit action labels by leveraging only video-text pairs. These weakly aligned data sources enable the model to learn continuous latent action representations through a newly designed multi-task pretraining objective. During fine-tuning, a small set of labeled data is used to train the action head for control. Experimental results across various simulation tasks demonstrate CARE's superior success rate, semantic interpretability, and ability to avoid shortcut learning. These results underscore CARE's scalability, interpretability, and effectiveness in robotic control with weak supervision.
title CARE: Multi-Task Pretraining for Latent Continuous Action Representation in Robot Control
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2601.22467