RLMiniStyler: Light-weight RL Style Agent for Arbitrary Sequential Neural Style Generation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hu, Jing, Feng, Chengming, Hu, Shu, Chang, Ming-Ching, Li, Xin, Wu, Xi, Wang, Xin
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910931339968512
author Hu, Jing
Feng, Chengming
Hu, Shu
Chang, Ming-Ching
Li, Xin
Wu, Xi
Wang, Xin
author_facet Hu, Jing
Feng, Chengming
Hu, Shu
Chang, Ming-Ching
Li, Xin
Wu, Xi
Wang, Xin
contents Arbitrary style transfer aims to apply the style of any given artistic image to another content image. Still, existing deep learning-based methods often require significant computational costs to generate diverse stylized results. Motivated by this, we propose a novel reinforcement learning-based framework for arbitrary style transfer RLMiniStyler. This framework leverages a unified reinforcement learning policy to iteratively guide the style transfer process by exploring and exploiting stylization feedback, generating smooth sequences of stylized results while achieving model lightweight. Furthermore, we introduce an uncertainty-aware multi-task learning strategy that automatically adjusts loss weights to adapt to the content and style balance requirements at different training stages, thereby accelerating model convergence. Through a series of experiments across image various resolutions, we have validated the advantages of RLMiniStyler over other state-of-the-art methods in generating high-quality, diverse artistic image sequences at a lower cost. Codes are available at https://github.com/fengxiaoming520/RLMiniStyler.
format Preprint
id arxiv_https___arxiv_org_abs_2505_04424
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle RLMiniStyler: Light-weight RL Style Agent for Arbitrary Sequential Neural Style Generation
Hu, Jing
Feng, Chengming
Hu, Shu
Chang, Ming-Ching
Li, Xin
Wu, Xi
Wang, Xin
Computer Vision and Pattern Recognition
Arbitrary style transfer aims to apply the style of any given artistic image to another content image. Still, existing deep learning-based methods often require significant computational costs to generate diverse stylized results. Motivated by this, we propose a novel reinforcement learning-based framework for arbitrary style transfer RLMiniStyler. This framework leverages a unified reinforcement learning policy to iteratively guide the style transfer process by exploring and exploiting stylization feedback, generating smooth sequences of stylized results while achieving model lightweight. Furthermore, we introduce an uncertainty-aware multi-task learning strategy that automatically adjusts loss weights to adapt to the content and style balance requirements at different training stages, thereby accelerating model convergence. Through a series of experiments across image various resolutions, we have validated the advantages of RLMiniStyler over other state-of-the-art methods in generating high-quality, diverse artistic image sequences at a lower cost. Codes are available at https://github.com/fengxiaoming520/RLMiniStyler.
title RLMiniStyler: Light-weight RL Style Agent for Arbitrary Sequential Neural Style Generation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.04424