MAST: Mask-Guided Attention Mass Allocation for Training-Free Multi-Style Transfer

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Kang, Dongkyung, Hwang, Jaeyeon, Park, Junseo, Kang, Minji, Lee, Yeryeong, Ko, Beomseok, Roh, Hanyoung, Shin, Jeongmin, Jang, Hyeryung
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911591835893760
author Kang, Dongkyung
Hwang, Jaeyeon
Park, Junseo
Kang, Minji
Lee, Yeryeong
Ko, Beomseok
Roh, Hanyoung
Shin, Jeongmin
Jang, Hyeryung
author_facet Kang, Dongkyung
Hwang, Jaeyeon
Park, Junseo
Kang, Minji
Lee, Yeryeong
Ko, Beomseok
Roh, Hanyoung
Shin, Jeongmin
Jang, Hyeryung
contents Style transfer aims to render a content image with the visual characteristics of a reference style while preserving its underlying semantic layout and structural geometry. While recent diffusion-based models demonstrate strong stylization capabilities by leveraging powerful generative priors and controllable internal representations, they typically assume a single global style. Extending them to multi-style scenarios often leads to boundary artifacts, unstable stylization, and structural inconsistency due to interference between multiple style representations. To overcome these limitations, we propose MAST (Mask-Guided Attention Mass Allocation for Training-Free Multi-Style Transfer), a novel training-free framework that explicitly controls content-style interactions within the diffusion attention mechanism. To achieve artifact-free and structure-preserving stylization, MAST integrates four connected modules. First, Layout-preserving Query Anchoring prevents global layout collapse by firmly anchoring the semantic structure using content queries. Second, Logit-level Attention Mass Allocation deterministically distributes attention probability mass across spatial regions, seamlessly fusing multiple styles without boundary artifacts. Third, Sharpness-aware Temperature Scaling restores the attention sharpness degraded by multi-style expansion. Finally, Discrepancy-aware Detail Injection adaptively compensates for localized high-frequency detail losses by measuring structural discrepancies. Extensive experiments demonstrate that MAST effectively mitigates boundary artifacts and maintains structural consistency, preserving texture fidelity and spatial coherence even as the number of applied styles increases.
format Preprint
id arxiv_https___arxiv_org_abs_2604_12281
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle MAST: Mask-Guided Attention Mass Allocation for Training-Free Multi-Style Transfer
Kang, Dongkyung
Hwang, Jaeyeon
Park, Junseo
Kang, Minji
Lee, Yeryeong
Ko, Beomseok
Roh, Hanyoung
Shin, Jeongmin
Jang, Hyeryung
Computer Vision and Pattern Recognition
Artificial Intelligence
Style transfer aims to render a content image with the visual characteristics of a reference style while preserving its underlying semantic layout and structural geometry. While recent diffusion-based models demonstrate strong stylization capabilities by leveraging powerful generative priors and controllable internal representations, they typically assume a single global style. Extending them to multi-style scenarios often leads to boundary artifacts, unstable stylization, and structural inconsistency due to interference between multiple style representations. To overcome these limitations, we propose MAST (Mask-Guided Attention Mass Allocation for Training-Free Multi-Style Transfer), a novel training-free framework that explicitly controls content-style interactions within the diffusion attention mechanism. To achieve artifact-free and structure-preserving stylization, MAST integrates four connected modules. First, Layout-preserving Query Anchoring prevents global layout collapse by firmly anchoring the semantic structure using content queries. Second, Logit-level Attention Mass Allocation deterministically distributes attention probability mass across spatial regions, seamlessly fusing multiple styles without boundary artifacts. Third, Sharpness-aware Temperature Scaling restores the attention sharpness degraded by multi-style expansion. Finally, Discrepancy-aware Detail Injection adaptively compensates for localized high-frequency detail losses by measuring structural discrepancies. Extensive experiments demonstrate that MAST effectively mitigates boundary artifacts and maintains structural consistency, preserving texture fidelity and spatial coherence even as the number of applied styles increases.
title MAST: Mask-Guided Attention Mass Allocation for Training-Free Multi-Style Transfer
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2604.12281