ConceptWeaver: Weaving Disentangled Concepts with Flow

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Chen, Jintao, Hao, Aiming, Chen, Xiaoqing, Bai, Chengyu, Chen, Chubin, Li, Yanxun, Wu, Jiahong, Chu, Xiangxiang, Zhang, Shanghang
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915899823357952
author Chen, Jintao
Hao, Aiming
Chen, Xiaoqing
Bai, Chengyu
Chen, Chubin
Li, Yanxun
Wu, Jiahong
Chu, Xiangxiang
Zhang, Shanghang
author_facet Chen, Jintao
Hao, Aiming
Chen, Xiaoqing
Bai, Chengyu
Chen, Chubin
Li, Yanxun
Wu, Jiahong
Chu, Xiangxiang
Zhang, Shanghang
contents Pre-trained flow-based models excel at synthesizing complex scenes yet lack a direct mechanism for disentangling and customizing their underlying concepts from one-shot real-world sources. To demystify this process, we first introduce a novel differential probing technique to isolate and analyze the influence of individual concept tokens on the velocity field over time. This investigation yields a critical insight: the generative process is not monolithic but unfolds in three distinct stages. An initial \textbf{Blueprint Stage} establishes low-frequency structure, followed by a pivotal \textbf{Instantiation Stage} where content concepts emerge with peak intensity and become naturally disentangled, creating an optimal window for manipulation. A final concept-insensitive refinement stage then synthesizes fine-grained details. Guided by this discovery, we propose \textbf{ConceptWeaver}, a framework for one-shot concept disentanglement. ConceptWeaver learns concept-specific semantic offsets from a single reference image using a stage-aware optimization strategy that aligns with the three-stage framework. These learned offsets are then deployed during inference via our novel ConceptWeaver Guidance (CWG) mechanism, which strategically injects them at the appropriate generative stage. Extensive experiments validate that ConceptWeaver enables high-fidelity, compositional synthesis and editing, demonstrating that understanding and leveraging the intrinsic, staged nature of flow models is key to unlocking precise, multi-granularity content manipulation.
format Preprint
id arxiv_https___arxiv_org_abs_2603_28493
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle ConceptWeaver: Weaving Disentangled Concepts with Flow
Chen, Jintao
Hao, Aiming
Chen, Xiaoqing
Bai, Chengyu
Chen, Chubin
Li, Yanxun
Wu, Jiahong
Chu, Xiangxiang
Zhang, Shanghang
Computer Vision and Pattern Recognition
Pre-trained flow-based models excel at synthesizing complex scenes yet lack a direct mechanism for disentangling and customizing their underlying concepts from one-shot real-world sources. To demystify this process, we first introduce a novel differential probing technique to isolate and analyze the influence of individual concept tokens on the velocity field over time. This investigation yields a critical insight: the generative process is not monolithic but unfolds in three distinct stages. An initial \textbf{Blueprint Stage} establishes low-frequency structure, followed by a pivotal \textbf{Instantiation Stage} where content concepts emerge with peak intensity and become naturally disentangled, creating an optimal window for manipulation. A final concept-insensitive refinement stage then synthesizes fine-grained details. Guided by this discovery, we propose \textbf{ConceptWeaver}, a framework for one-shot concept disentanglement. ConceptWeaver learns concept-specific semantic offsets from a single reference image using a stage-aware optimization strategy that aligns with the three-stage framework. These learned offsets are then deployed during inference via our novel ConceptWeaver Guidance (CWG) mechanism, which strategically injects them at the appropriate generative stage. Extensive experiments validate that ConceptWeaver enables high-fidelity, compositional synthesis and editing, demonstrating that understanding and leveraging the intrinsic, staged nature of flow models is key to unlocking precise, multi-granularity content manipulation.
title ConceptWeaver: Weaving Disentangled Concepts with Flow
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.28493