Hyper-DP3: Frequency-Aware Right-Sizing of 3D Diffusion Policies for Visuomotor Control

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Jinhao, Zhou, Zhexuan, Li, Huizhe, Lai, Yichen, Xia, Wenlong, Song, Haoming, Gong, Youmin, Mei, Jie
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913171829161984
author Zhang, Jinhao
Zhou, Zhexuan
Li, Huizhe
Lai, Yichen
Xia, Wenlong
Song, Haoming
Gong, Youmin
Mei, Jie
author_facet Zhang, Jinhao
Zhou, Zhexuan
Li, Huizhe
Lai, Yichen
Xia, Wenlong
Song, Haoming
Gong, Youmin
Mei, Jie
contents Diffusion-based visuomotor policies perform well in robotic manipulation, yet current methods still inherit image-generation-style decoders and multi-step sampling. We revisit this design from a frequency-domain perspective. Robot action trajectories are highly smooth, with most energy concentrated in a few low-frequency discrete cosine transform modes. Under this structure, we show that the error of the optimal denoiser is bounded by the low-frequency subspace dimension and residual high-frequency energy, implying that denoising error saturates after very few reverse steps. This also suggests that action denoising requires a much simpler denoising model than image generation. Motivated by this insight, we propose Hyper-DP3 (HDP3), a pocket-scale 3D diffusion policy with a lightweight Diffusion Mixer decoder that supports two-step DDIM inference. Our synthetic experiments validate the theory and support the sufficiency of two-step denoising. Futhermore, across RoboTwin2.0, Adroit, MetaWorld, and real-world tasks, HDP3 achieves state-of-the-art performance with fewer than 1% of the parameters of prior 3D diffusion-based policies and substantially lower inference latency.
format Preprint
id arxiv_https___arxiv_org_abs_2605_01581
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Hyper-DP3: Frequency-Aware Right-Sizing of 3D Diffusion Policies for Visuomotor Control
Zhang, Jinhao
Zhou, Zhexuan
Li, Huizhe
Lai, Yichen
Xia, Wenlong
Song, Haoming
Gong, Youmin
Mei, Jie
Robotics
Diffusion-based visuomotor policies perform well in robotic manipulation, yet current methods still inherit image-generation-style decoders and multi-step sampling. We revisit this design from a frequency-domain perspective. Robot action trajectories are highly smooth, with most energy concentrated in a few low-frequency discrete cosine transform modes. Under this structure, we show that the error of the optimal denoiser is bounded by the low-frequency subspace dimension and residual high-frequency energy, implying that denoising error saturates after very few reverse steps. This also suggests that action denoising requires a much simpler denoising model than image generation. Motivated by this insight, we propose Hyper-DP3 (HDP3), a pocket-scale 3D diffusion policy with a lightweight Diffusion Mixer decoder that supports two-step DDIM inference. Our synthetic experiments validate the theory and support the sufficiency of two-step denoising. Futhermore, across RoboTwin2.0, Adroit, MetaWorld, and real-world tasks, HDP3 achieves state-of-the-art performance with fewer than 1% of the parameters of prior 3D diffusion-based policies and substantially lower inference latency.
title Hyper-DP3: Frequency-Aware Right-Sizing of 3D Diffusion Policies for Visuomotor Control
topic Robotics
url https://arxiv.org/abs/2605.01581