Saved in:
Bibliographic Details
Main Authors: Yashima, Daichi, Seno, Koki, Kurita, Shuhei, Oda, Yusuke, Sugiura, Komei
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2603.27281
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915897253298176
author Yashima, Daichi
Seno, Koki
Kurita, Shuhei
Oda, Yusuke
Sugiura, Komei
author_facet Yashima, Daichi
Seno, Koki
Kurita, Shuhei
Oda, Yusuke
Sugiura, Komei
contents Coarse-to-fine autoregressive modeling has recently shown strong promise for visuomotor policy learning, combining the inference efficiency of autoregressive methods with the global trajectory coherence of diffusion-based policies. However, existing approaches rely on discrete action tokenizers that map continuous action sequences to codebook indices, a design inherited from image generation where learned compression is necessary for high-dimensional pixel data. We observe that robot actions are inherently low-dimensional continuous vectors, for which such tokenization introduces unnecessary quantization error and a multi-stage training pipeline. In this work, we propose Hierarchical Flow Policy (HiFlow), a tokenization-free coarse-to-fine autoregressive policy that operates directly on raw continuous actions. HiFlow constructs multi-scale continuous action targets from each action chunk via simple temporal pooling. Specifically, it averages contiguous action windows to produce coarse summaries that are refined at finer temporal resolutions. The entire model is trained end-to-end in a single stage, eliminating the need for a separate tokenizer. Experiments on MimicGen, RoboTwin 2.0, and real-world environments demonstrate that HiFlow consistently outperforms existing methods including diffusion-based and tokenization-based autoregressive policies.
format Preprint
id arxiv_https___arxiv_org_abs_2603_27281
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle HiFlow: Tokenization-Free Scale-Wise Autoregressive Policy Learning via Flow Matching
Yashima, Daichi
Seno, Koki
Kurita, Shuhei
Oda, Yusuke
Sugiura, Komei
Robotics
Coarse-to-fine autoregressive modeling has recently shown strong promise for visuomotor policy learning, combining the inference efficiency of autoregressive methods with the global trajectory coherence of diffusion-based policies. However, existing approaches rely on discrete action tokenizers that map continuous action sequences to codebook indices, a design inherited from image generation where learned compression is necessary for high-dimensional pixel data. We observe that robot actions are inherently low-dimensional continuous vectors, for which such tokenization introduces unnecessary quantization error and a multi-stage training pipeline. In this work, we propose Hierarchical Flow Policy (HiFlow), a tokenization-free coarse-to-fine autoregressive policy that operates directly on raw continuous actions. HiFlow constructs multi-scale continuous action targets from each action chunk via simple temporal pooling. Specifically, it averages contiguous action windows to produce coarse summaries that are refined at finer temporal resolutions. The entire model is trained end-to-end in a single stage, eliminating the need for a separate tokenizer. Experiments on MimicGen, RoboTwin 2.0, and real-world environments demonstrate that HiFlow consistently outperforms existing methods including diffusion-based and tokenization-based autoregressive policies.
title HiFlow: Tokenization-Free Scale-Wise Autoregressive Policy Learning via Flow Matching
topic Robotics
url https://arxiv.org/abs/2603.27281