Joint Model-based Model-free Diffusion for Planning with Constraints

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Jung, Wonsuhk, Mishra, Utkarsh A., Arachchige, Nadun Ranawaka, Chen, Yongxin, Xu, Danfei, Kousik, Shreyas
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916945796792320
author Jung, Wonsuhk
Mishra, Utkarsh A.
Arachchige, Nadun Ranawaka
Chen, Yongxin
Xu, Danfei
Kousik, Shreyas
author_facet Jung, Wonsuhk
Mishra, Utkarsh A.
Arachchige, Nadun Ranawaka
Chen, Yongxin
Xu, Danfei
Kousik, Shreyas
contents Model-free diffusion planners have shown great promise for robot motion planning, but practical robotic systems often require combining them with model-based optimization modules to enforce constraints, such as safety. Naively integrating these modules presents compatibility challenges when diffusion's multi-modal outputs behave adversarially to optimization-based modules. To address this, we introduce Joint Model-based Model-free Diffusion (JM2D), a novel generative modeling framework. JM2D formulates module integration as a joint sampling problem to maximize compatibility via an interaction potential, without additional training. Using importance sampling, JM2D guides modules outputs based only on evaluations of the interaction potential, thus handling non-differentiable objectives commonly arising from non-convex optimization modules. We evaluate JM2D via application to aligning diffusion planners with safety modules on offline RL and robot manipulation. JM2D significantly improves task performance compared to conventional safety filters without sacrificing safety. Further, we show that conditional generation is a special case of JM2D and elucidate key design choices by comparing with SOTA gradient-based and projection-based diffusion planners. More details at: https://jm2d-corl25.github.io/.
format Preprint
id arxiv_https___arxiv_org_abs_2509_08775
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Joint Model-based Model-free Diffusion for Planning with Constraints
Jung, Wonsuhk
Mishra, Utkarsh A.
Arachchige, Nadun Ranawaka
Chen, Yongxin
Xu, Danfei
Kousik, Shreyas
Robotics
Model-free diffusion planners have shown great promise for robot motion planning, but practical robotic systems often require combining them with model-based optimization modules to enforce constraints, such as safety. Naively integrating these modules presents compatibility challenges when diffusion's multi-modal outputs behave adversarially to optimization-based modules. To address this, we introduce Joint Model-based Model-free Diffusion (JM2D), a novel generative modeling framework. JM2D formulates module integration as a joint sampling problem to maximize compatibility via an interaction potential, without additional training. Using importance sampling, JM2D guides modules outputs based only on evaluations of the interaction potential, thus handling non-differentiable objectives commonly arising from non-convex optimization modules. We evaluate JM2D via application to aligning diffusion planners with safety modules on offline RL and robot manipulation. JM2D significantly improves task performance compared to conventional safety filters without sacrificing safety. Further, we show that conditional generation is a special case of JM2D and elucidate key design choices by comparing with SOTA gradient-based and projection-based diffusion planners. More details at: https://jm2d-corl25.github.io/.
title Joint Model-based Model-free Diffusion for Planning with Constraints
topic Robotics
url https://arxiv.org/abs/2509.08775