Language-based Color ISP Tuning
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866915493543149568 |
|---|---|
| author | Mayer, Owen Noguchi, Shohei Berestov, Alexander Takatori, Jiro |
| author_facet | Mayer, Owen Noguchi, Shohei Berestov, Alexander Takatori, Jiro |
| contents | We propose a method for tuning the parameters of a color adjustment Image Signal Processor (ISP) algorithmic "block" using language prompts. This enables the user to impart a particular visual style to the ISP-processed image simply by describing it through a text prompt. To do this, we first implement the ISP block in a differentiable manner. Then, we define an objective function using an off-the-shelf, pretrained vision-language model (VLM) such that the objective is minimized when the ISP processed image is most visually similar to the input language prompt. Finally, we optimize the ISP parameters using gradient descent. Experimental results demonstrate tuning of ISP parameters with different language prompts, and compare the performance of different pretrained VLMs and optimization strategies. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_10765 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Language-based Color ISP Tuning Mayer, Owen Noguchi, Shohei Berestov, Alexander Takatori, Jiro Image and Video Processing We propose a method for tuning the parameters of a color adjustment Image Signal Processor (ISP) algorithmic "block" using language prompts. This enables the user to impart a particular visual style to the ISP-processed image simply by describing it through a text prompt. To do this, we first implement the ISP block in a differentiable manner. Then, we define an objective function using an off-the-shelf, pretrained vision-language model (VLM) such that the objective is minimized when the ISP processed image is most visually similar to the input language prompt. Finally, we optimize the ISP parameters using gradient descent. Experimental results demonstrate tuning of ISP parameters with different language prompts, and compare the performance of different pretrained VLMs and optimization strategies. |
| title | Language-based Color ISP Tuning |
| topic | Image and Video Processing |
| url | https://arxiv.org/abs/2509.10765 |