Coarse-to-Fine Compositional Diffusion for Long-Horizon Planning

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Park, Byoungwoo, Mishra, Utkarsh A., Choi, Jaemoo, Lee, Juho, Chen, Yongxin
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910276475944960
author Park, Byoungwoo
Mishra, Utkarsh A.
Choi, Jaemoo
Lee, Juho
Chen, Yongxin
author_facet Park, Byoungwoo
Mishra, Utkarsh A.
Choi, Jaemoo
Lee, Juho
Chen, Yongxin
contents Diffusion models provide strong priors for generating structured data, but many tasks require outputs beyond the scale on which these models are typically trained. Compositional generation addresses this by composing overlapping local plans from a pretrained short-horizon prior into a long-horizon output. However, standard composition primarily enforces agreement between neighboring local plans, yielding local consistency without directly specifying the global structure of the full composition. As a result, locally compatible plans may still form an implausible route, task sequence, or temporal evolution. Existing methods improve global coherence by repeatedly propagating local consistency signals or by adding inference-time optimization, but these procedures become expensive as the number or dimensionality of local plans increases. We propose Coarse-to-Fine Compositional Diffusion (CoFi), an inference-time sampler that separates global structure formation from local detail refinement. CoFi first aligns local denoised estimates around a shared coarse structure, producing a global scaffold that captures the long-range task-level arrangement. It then diffuses this scaffold to an intermediate noise level and denoises it with the same pretrained local prior, restoring local fine structure while preserving the scaffold-induced global coherence. Across long-horizon robotic planning, panoramic image generation, and long video generation, CoFi not only improves both global coherence and local sample quality over prior compositional baselines, but also requires 2-8x fewer denoiser evaluations.
format Preprint
id arxiv_https___arxiv_org_abs_2606_00837
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Coarse-to-Fine Compositional Diffusion for Long-Horizon Planning
Park, Byoungwoo
Mishra, Utkarsh A.
Choi, Jaemoo
Lee, Juho
Chen, Yongxin
Robotics
Machine Learning
Diffusion models provide strong priors for generating structured data, but many tasks require outputs beyond the scale on which these models are typically trained. Compositional generation addresses this by composing overlapping local plans from a pretrained short-horizon prior into a long-horizon output. However, standard composition primarily enforces agreement between neighboring local plans, yielding local consistency without directly specifying the global structure of the full composition. As a result, locally compatible plans may still form an implausible route, task sequence, or temporal evolution. Existing methods improve global coherence by repeatedly propagating local consistency signals or by adding inference-time optimization, but these procedures become expensive as the number or dimensionality of local plans increases. We propose Coarse-to-Fine Compositional Diffusion (CoFi), an inference-time sampler that separates global structure formation from local detail refinement. CoFi first aligns local denoised estimates around a shared coarse structure, producing a global scaffold that captures the long-range task-level arrangement. It then diffuses this scaffold to an intermediate noise level and denoises it with the same pretrained local prior, restoring local fine structure while preserving the scaffold-induced global coherence. Across long-horizon robotic planning, panoramic image generation, and long video generation, CoFi not only improves both global coherence and local sample quality over prior compositional baselines, but also requires 2-8x fewer denoiser evaluations.
title Coarse-to-Fine Compositional Diffusion for Long-Horizon Planning
topic Robotics
Machine Learning
url https://arxiv.org/abs/2606.00837