Asynchronous Fast-Slow Vision-Language-Action Policies for Whole-Body Robotic Manipulation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zou, Teqiang, Zeng, Hongliang, Nong, Yuxuan, Li, Yifan, Liu, Kehui, Yang, Haotian, Ling, Xinyang, Li, Xin, Ma, Lianyang
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914217027698688
author Zou, Teqiang
Zeng, Hongliang
Nong, Yuxuan
Li, Yifan
Liu, Kehui
Yang, Haotian
Ling, Xinyang
Li, Xin
Ma, Lianyang
author_facet Zou, Teqiang
Zeng, Hongliang
Nong, Yuxuan
Li, Yifan
Liu, Kehui
Yang, Haotian
Ling, Xinyang
Li, Xin
Ma, Lianyang
contents Most Vision-Language-Action (VLA) systems integrate a Vision-Language Model (VLM) for semantic reasoning with an action expert generating continuous action signals, yet both typically run at a single unified frequency. As a result, policy performance is constrained by the low inference speed of large VLMs. This mandatory synchronous execution severely limits control stability and real-time performance in whole-body robotic manipulation, which involves more joints, larger motion spaces, and dynamically changing views. We introduce a truly asynchronous Fast-Slow VLA framework (DuoCore-FS), organizing the system into a fast pathway for high-frequency action generation and a slow pathway for rich VLM reasoning. The system is characterized by two key features. First, a latent representation buffer bridges the slow and fast systems. It stores instruction semantics and action-reasoning representation aligned with the scene-instruction context, providing high-level guidance to the fast pathway. Second, a whole-body action tokenizer provides a compact, unified representation of whole-body actions. Importantly, the VLM and action expert are still jointly trained end-to-end, preserving unified policy learning while enabling asynchronous execution. DuoCore-FS supports a 3B-parameter VLM while achieving 30 Hz whole-body action-chunk generation, approximately three times as fast as prior VLA models with comparable model sizes. Real-world whole-body manipulation experiments demonstrate improved task success rates and significantly enhanced responsiveness compared to synchronous Fast-Slow VLA baselines. The implementation of DuoCore-FS, including training, inference, and deployment, is provided to commercial users by Astribot as part of the Astribot robotic platform.
format Preprint
id arxiv_https___arxiv_org_abs_2512_20188
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Asynchronous Fast-Slow Vision-Language-Action Policies for Whole-Body Robotic Manipulation
Zou, Teqiang
Zeng, Hongliang
Nong, Yuxuan
Li, Yifan
Liu, Kehui
Yang, Haotian
Ling, Xinyang
Li, Xin
Ma, Lianyang
Robotics
Artificial Intelligence
Most Vision-Language-Action (VLA) systems integrate a Vision-Language Model (VLM) for semantic reasoning with an action expert generating continuous action signals, yet both typically run at a single unified frequency. As a result, policy performance is constrained by the low inference speed of large VLMs. This mandatory synchronous execution severely limits control stability and real-time performance in whole-body robotic manipulation, which involves more joints, larger motion spaces, and dynamically changing views. We introduce a truly asynchronous Fast-Slow VLA framework (DuoCore-FS), organizing the system into a fast pathway for high-frequency action generation and a slow pathway for rich VLM reasoning. The system is characterized by two key features. First, a latent representation buffer bridges the slow and fast systems. It stores instruction semantics and action-reasoning representation aligned with the scene-instruction context, providing high-level guidance to the fast pathway. Second, a whole-body action tokenizer provides a compact, unified representation of whole-body actions. Importantly, the VLM and action expert are still jointly trained end-to-end, preserving unified policy learning while enabling asynchronous execution. DuoCore-FS supports a 3B-parameter VLM while achieving 30 Hz whole-body action-chunk generation, approximately three times as fast as prior VLA models with comparable model sizes. Real-world whole-body manipulation experiments demonstrate improved task success rates and significantly enhanced responsiveness compared to synchronous Fast-Slow VLA baselines. The implementation of DuoCore-FS, including training, inference, and deployment, is provided to commercial users by Astribot as part of the Astribot robotic platform.
title Asynchronous Fast-Slow Vision-Language-Action Policies for Whole-Body Robotic Manipulation
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2512.20188