HSI: A Holistic Style Injector for Arbitrary Style Transfer

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhang, Shuhao, Kang, Hui, Liu, Yang, Mei, Fang, Li, Hongjuan
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912222664458240
author Zhang, Shuhao
Kang, Hui
Liu, Yang
Mei, Fang
Li, Hongjuan
author_facet Zhang, Shuhao
Kang, Hui
Liu, Yang
Mei, Fang
Li, Hongjuan
contents Attention-based arbitrary style transfer methods have gained significant attention recently due to their impressive ability to synthesize style details. However, the point-wise matching within the attention mechanism may overly focus on local patterns such that neglect the remarkable global features of style images. Additionally, when processing large images, the quadratic complexity of the attention mechanism will bring high computational load. To alleviate above problems, we propose Holistic Style Injector (HSI), a novel attention-style transformation module to deliver artistic expression of target style. Specifically, HSI performs stylization only based on global style representation that is more in line with the characteristics of style transfer, to avoid generating local disharmonious patterns in stylized images. Moreover, we propose a dual relation learning mechanism inside the HSI to dynamically render images by leveraging semantic similarity in content and style, ensuring the stylized images preserve the original content and improve style fidelity. Note that the proposed HSI achieves linear computational complexity because it establishes feature mapping through element-wise multiplication rather than matrix multiplication. Qualitative and quantitative results demonstrate that our method outperforms state-of-the-art approaches in both effectiveness and efficiency.
format Preprint
id arxiv_https___arxiv_org_abs_2502_04369
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle HSI: A Holistic Style Injector for Arbitrary Style Transfer
Zhang, Shuhao
Kang, Hui
Liu, Yang
Mei, Fang
Li, Hongjuan
Computer Vision and Pattern Recognition
Machine Learning
Image and Video Processing
Attention-based arbitrary style transfer methods have gained significant attention recently due to their impressive ability to synthesize style details. However, the point-wise matching within the attention mechanism may overly focus on local patterns such that neglect the remarkable global features of style images. Additionally, when processing large images, the quadratic complexity of the attention mechanism will bring high computational load. To alleviate above problems, we propose Holistic Style Injector (HSI), a novel attention-style transformation module to deliver artistic expression of target style. Specifically, HSI performs stylization only based on global style representation that is more in line with the characteristics of style transfer, to avoid generating local disharmonious patterns in stylized images. Moreover, we propose a dual relation learning mechanism inside the HSI to dynamically render images by leveraging semantic similarity in content and style, ensuring the stylized images preserve the original content and improve style fidelity. Note that the proposed HSI achieves linear computational complexity because it establishes feature mapping through element-wise multiplication rather than matrix multiplication. Qualitative and quantitative results demonstrate that our method outperforms state-of-the-art approaches in both effectiveness and efficiency.
title HSI: A Holistic Style Injector for Arbitrary Style Transfer
topic Computer Vision and Pattern Recognition
Machine Learning
Image and Video Processing
url https://arxiv.org/abs/2502.04369