Real-Time Robot Execution with Masked Action Chunking

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wang, Haoxuan, Zhang, Gengyu, Yan, Yan, Shang, Yuzhang, Kompella, Ramana Rao, Liu, Gaowen
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918310515310592
author Wang, Haoxuan
Zhang, Gengyu
Yan, Yan
Shang, Yuzhang
Kompella, Ramana Rao
Liu, Gaowen
author_facet Wang, Haoxuan
Zhang, Gengyu
Yan, Yan
Shang, Yuzhang
Kompella, Ramana Rao
Liu, Gaowen
contents Real-time execution is essential for cyber-physical systems such as robots. These systems operate in dynamic real-world environments where even small delays can undermine responsiveness and compromise performance. Asynchronous inference has recently emerged as a system-level paradigm for real-time robot manipulation, enabling the next action chunk to be predicted while the current one is being executed. While this approach achieves real-time responsiveness, naive integration often results in execution failure. Previous methods attributed this failure to inter-chunk discontinuity and developed test-time algorithms to smooth chunk boundaries. In contrast, we identify another critical yet overlooked factor: intra-chunk inconsistency, where the robot's executed action chunk partially misaligns with its current perception. To address this, we propose REMAC, which learns corrective adjustments on the pretrained policy through masked action chunking, enabling the policy to remain resilient under mismatches between intended actions and actual execution during asynchronous inference. In addition, we introduce a prefix-preserved sampling procedure to reinforce inter-chunk continuity. Overall, our method delivers more reliable policies without incurring additional latency. Extensive experiments in both simulation and real-world settings demonstrate that our method enables faster task execution, maintains robustness across varying delays, and consistently achieves higher completion rates.
format Preprint
id arxiv_https___arxiv_org_abs_2601_20130
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Real-Time Robot Execution with Masked Action Chunking
Wang, Haoxuan
Zhang, Gengyu
Yan, Yan
Shang, Yuzhang
Kompella, Ramana Rao
Liu, Gaowen
Robotics
Real-time execution is essential for cyber-physical systems such as robots. These systems operate in dynamic real-world environments where even small delays can undermine responsiveness and compromise performance. Asynchronous inference has recently emerged as a system-level paradigm for real-time robot manipulation, enabling the next action chunk to be predicted while the current one is being executed. While this approach achieves real-time responsiveness, naive integration often results in execution failure. Previous methods attributed this failure to inter-chunk discontinuity and developed test-time algorithms to smooth chunk boundaries. In contrast, we identify another critical yet overlooked factor: intra-chunk inconsistency, where the robot's executed action chunk partially misaligns with its current perception. To address this, we propose REMAC, which learns corrective adjustments on the pretrained policy through masked action chunking, enabling the policy to remain resilient under mismatches between intended actions and actual execution during asynchronous inference. In addition, we introduce a prefix-preserved sampling procedure to reinforce inter-chunk continuity. Overall, our method delivers more reliable policies without incurring additional latency. Extensive experiments in both simulation and real-world settings demonstrate that our method enables faster task execution, maintains robustness across varying delays, and consistently achieves higher completion rates.
title Real-Time Robot Execution with Masked Action Chunking
topic Robotics
url https://arxiv.org/abs/2601.20130