Goal Conditioned Reinforcement Learning for Photo Finishing Tuning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wu, Jiarui, Wang, Yujin, Li, Lingen, Fan, Zhang, Xue, Tianfan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913728010649600
author Wu, Jiarui
Wang, Yujin
Li, Lingen
Fan, Zhang
Xue, Tianfan
author_facet Wu, Jiarui
Wang, Yujin
Li, Lingen
Fan, Zhang
Xue, Tianfan
contents Photo finishing tuning aims to automate the manual tuning process of the photo finishing pipeline, like Adobe Lightroom or Darktable. Previous works either use zeroth-order optimization, which is slow when the set of parameters increases, or rely on a differentiable proxy of the target finishing pipeline, which is hard to train. To overcome these challenges, we propose a novel goal-conditioned reinforcement learning framework for efficiently tuning parameters using a goal image as a condition. Unlike previous approaches, our tuning framework does not rely on any proxy and treats the photo finishing pipeline as a black box. Utilizing a trained reinforcement learning policy, it can efficiently find the desired set of parameters within just 10 queries, while optimization based approaches normally take 200 queries. Furthermore, our architecture utilizes a goal image to guide the iterative tuning of pipeline parameters, allowing for flexible conditioning on pixel-aligned target images, style images, or any other visually representable goals. We conduct detailed experiments on photo finishing tuning and photo stylization tuning tasks, demonstrating the advantages of our method. Project website: https://openimaginglab.github.io/RLPixTuner/.
format Preprint
id arxiv_https___arxiv_org_abs_2503_07300
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Goal Conditioned Reinforcement Learning for Photo Finishing Tuning
Wu, Jiarui
Wang, Yujin
Li, Lingen
Fan, Zhang
Xue, Tianfan
Graphics
Computer Vision and Pattern Recognition
Photo finishing tuning aims to automate the manual tuning process of the photo finishing pipeline, like Adobe Lightroom or Darktable. Previous works either use zeroth-order optimization, which is slow when the set of parameters increases, or rely on a differentiable proxy of the target finishing pipeline, which is hard to train. To overcome these challenges, we propose a novel goal-conditioned reinforcement learning framework for efficiently tuning parameters using a goal image as a condition. Unlike previous approaches, our tuning framework does not rely on any proxy and treats the photo finishing pipeline as a black box. Utilizing a trained reinforcement learning policy, it can efficiently find the desired set of parameters within just 10 queries, while optimization based approaches normally take 200 queries. Furthermore, our architecture utilizes a goal image to guide the iterative tuning of pipeline parameters, allowing for flexible conditioning on pixel-aligned target images, style images, or any other visually representable goals. We conduct detailed experiments on photo finishing tuning and photo stylization tuning tasks, demonstrating the advantages of our method. Project website: https://openimaginglab.github.io/RLPixTuner/.
title Goal Conditioned Reinforcement Learning for Photo Finishing Tuning
topic Graphics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.07300