ForeDiffusion: Foresight-Conditioned Diffusion Policy via Future View Construction for Robot Manipulation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Xie, Weize, Ding, Yi, He, Ying, Wang, Leilei, Bai, Binwen, Zhao, Zheyi, Wang, Chenyang, Yu, F. Richard
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917210007535616
author Xie, Weize
Ding, Yi
He, Ying
Wang, Leilei
Bai, Binwen
Zhao, Zheyi
Wang, Chenyang
Yu, F. Richard
author_facet Xie, Weize
Ding, Yi
He, Ying
Wang, Leilei
Bai, Binwen
Zhao, Zheyi
Wang, Chenyang
Yu, F. Richard
contents Diffusion strategies have advanced visual motor control by progressively denoising high-dimensional action sequences, providing a promising method for robot manipulation. However, as task complexity increases, the success rate of existing baseline models decreases considerably. Analysis indicates that current diffusion strategies are confronted with two limitations. First, these strategies only rely on short-term observations as conditions. Second, the training objective remains limited to a single denoising loss, which leads to error accumulation and causes grasping deviations. To address these limitations, this paper proposes Foresight-Conditioned Diffusion (ForeDiffusion), by injecting the predicted future view representation into the diffusion process. As a result, the policy is guided to be forward-looking, enabling it to correct trajectory deviations. Following this design, ForeDiffusion employs a dual loss mechanism, combining the traditional denoising loss and the consistency loss of future observations, to achieve the unified optimization. Extensive evaluation on the Adroit suite and the MetaWorld benchmark demonstrates that ForeDiffusion achieves an average success rate of 80% for the overall task, significantly outperforming the existing mainstream diffusion methods by 23% in complex tasks, while maintaining more stable performance across the entire tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2601_12925
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle ForeDiffusion: Foresight-Conditioned Diffusion Policy via Future View Construction for Robot Manipulation
Xie, Weize
Ding, Yi
He, Ying
Wang, Leilei
Bai, Binwen
Zhao, Zheyi
Wang, Chenyang
Yu, F. Richard
Robotics
Artificial Intelligence
Diffusion strategies have advanced visual motor control by progressively denoising high-dimensional action sequences, providing a promising method for robot manipulation. However, as task complexity increases, the success rate of existing baseline models decreases considerably. Analysis indicates that current diffusion strategies are confronted with two limitations. First, these strategies only rely on short-term observations as conditions. Second, the training objective remains limited to a single denoising loss, which leads to error accumulation and causes grasping deviations. To address these limitations, this paper proposes Foresight-Conditioned Diffusion (ForeDiffusion), by injecting the predicted future view representation into the diffusion process. As a result, the policy is guided to be forward-looking, enabling it to correct trajectory deviations. Following this design, ForeDiffusion employs a dual loss mechanism, combining the traditional denoising loss and the consistency loss of future observations, to achieve the unified optimization. Extensive evaluation on the Adroit suite and the MetaWorld benchmark demonstrates that ForeDiffusion achieves an average success rate of 80% for the overall task, significantly outperforming the existing mainstream diffusion methods by 23% in complex tasks, while maintaining more stable performance across the entire tasks.
title ForeDiffusion: Foresight-Conditioned Diffusion Policy via Future View Construction for Robot Manipulation
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2601.12925