SeaDAG: Semi-autoregressive Diffusion for Conditional Directed Acyclic Graph Generation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhou, Xinyi, Li, Xing, Lian, Yingzhao, Wang, Yiwen, Chen, Lei, Yuan, Mingxuan, Hao, Jianye, Chen, Guangyong, Heng, Pheng Ann
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929551871836160
author Zhou, Xinyi
Li, Xing
Lian, Yingzhao
Wang, Yiwen
Chen, Lei
Yuan, Mingxuan
Hao, Jianye
Chen, Guangyong
Heng, Pheng Ann
author_facet Zhou, Xinyi
Li, Xing
Lian, Yingzhao
Wang, Yiwen
Chen, Lei
Yuan, Mingxuan
Hao, Jianye
Chen, Guangyong
Heng, Pheng Ann
contents We introduce SeaDAG, a semi-autoregressive diffusion model for conditional generation of Directed Acyclic Graphs (DAGs). Considering their inherent layer-wise structure, we simulate layer-wise autoregressive generation by designing different denoising speed for different layers. Unlike conventional autoregressive generation that lacks a global graph structure view, our method maintains a complete graph structure at each diffusion step, enabling operations such as property control that require the full graph structure. Leveraging this capability, we evaluate the DAG properties during training by employing a graph property decoder. We explicitly train the model to learn graph conditioning with a condition loss, which enhances the diffusion model's capacity to generate graphs that are both realistic and aligned with specified properties. We evaluate our method on two representative conditional DAG generation tasks: (1) circuit generation from truth tables, where precise DAG structures are crucial for realizing circuit functionality, and (2) molecule generation based on quantum properties. Our approach demonstrates promising results, generating high-quality and realistic DAGs that closely align with given conditions.
format Preprint
id arxiv_https___arxiv_org_abs_2410_16119
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle SeaDAG: Semi-autoregressive Diffusion for Conditional Directed Acyclic Graph Generation
Zhou, Xinyi
Li, Xing
Lian, Yingzhao
Wang, Yiwen
Chen, Lei
Yuan, Mingxuan
Hao, Jianye
Chen, Guangyong
Heng, Pheng Ann
Machine Learning
Artificial Intelligence
We introduce SeaDAG, a semi-autoregressive diffusion model for conditional generation of Directed Acyclic Graphs (DAGs). Considering their inherent layer-wise structure, we simulate layer-wise autoregressive generation by designing different denoising speed for different layers. Unlike conventional autoregressive generation that lacks a global graph structure view, our method maintains a complete graph structure at each diffusion step, enabling operations such as property control that require the full graph structure. Leveraging this capability, we evaluate the DAG properties during training by employing a graph property decoder. We explicitly train the model to learn graph conditioning with a condition loss, which enhances the diffusion model's capacity to generate graphs that are both realistic and aligned with specified properties. We evaluate our method on two representative conditional DAG generation tasks: (1) circuit generation from truth tables, where precise DAG structures are crucial for realizing circuit functionality, and (2) molecule generation based on quantum properties. Our approach demonstrates promising results, generating high-quality and realistic DAGs that closely align with given conditions.
title SeaDAG: Semi-autoregressive Diffusion for Conditional Directed Acyclic Graph Generation
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2410.16119