Efficient Diffusion Planning with Temporal Diffusion

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Guo, Jiaming, Zhang, Rui, Li, Zerun, Gao, Yunkai, Peng, Shaohui, Lan, Siming, Hu, Xing, Du, Zidong, Zhang, Xishan, Li, Ling
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914171417788416
author Guo, Jiaming
Zhang, Rui
Li, Zerun
Gao, Yunkai
Peng, Shaohui
Lan, Siming
Hu, Xing
Du, Zidong
Zhang, Xishan
Li, Ling
author_facet Guo, Jiaming
Zhang, Rui
Li, Zerun
Gao, Yunkai
Peng, Shaohui
Lan, Siming
Hu, Xing
Du, Zidong
Zhang, Xishan
Li, Ling
contents Diffusion planning is a promising method for learning high-performance policies from offline data. To avoid the impact of discrepancies between planning and reality on performance, previous works generate new plans at each time step. However, this incurs significant computational overhead and leads to lower decision frequencies, and frequent plan switching may also affect performance. In contrast, humans might create detailed short-term plans and more general, sometimes vague, long-term plans, and adjust them over time. Inspired by this, we propose the Temporal Diffusion Planner (TDP) which improves decision efficiency by distributing the denoising steps across the time dimension. TDP begins by generating an initial plan that becomes progressively more vague over time. At each subsequent time step, rather than generating an entirely new plan, TDP updates the previous one with a small number of denoising steps. This reduces the average number of denoising steps, improving decision efficiency. Additionally, we introduce an automated replanning mechanism to prevent significant deviations between the plan and reality. Experiments on D4RL show that, compared to previous works that generate new plans every time step, TDP improves the decision-making frequency by 11-24.8 times while achieving higher or comparable performance.
format Preprint
id arxiv_https___arxiv_org_abs_2511_21054
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Efficient Diffusion Planning with Temporal Diffusion
Guo, Jiaming
Zhang, Rui
Li, Zerun
Gao, Yunkai
Peng, Shaohui
Lan, Siming
Hu, Xing
Du, Zidong
Zhang, Xishan
Li, Ling
Machine Learning
Diffusion planning is a promising method for learning high-performance policies from offline data. To avoid the impact of discrepancies between planning and reality on performance, previous works generate new plans at each time step. However, this incurs significant computational overhead and leads to lower decision frequencies, and frequent plan switching may also affect performance. In contrast, humans might create detailed short-term plans and more general, sometimes vague, long-term plans, and adjust them over time. Inspired by this, we propose the Temporal Diffusion Planner (TDP) which improves decision efficiency by distributing the denoising steps across the time dimension. TDP begins by generating an initial plan that becomes progressively more vague over time. At each subsequent time step, rather than generating an entirely new plan, TDP updates the previous one with a small number of denoising steps. This reduces the average number of denoising steps, improving decision efficiency. Additionally, we introduce an automated replanning mechanism to prevent significant deviations between the plan and reality. Experiments on D4RL show that, compared to previous works that generate new plans every time step, TDP improves the decision-making frequency by 11-24.8 times while achieving higher or comparable performance.
title Efficient Diffusion Planning with Temporal Diffusion
topic Machine Learning
url https://arxiv.org/abs/2511.21054