A Preliminary Study on GPT-Image Generation Model for Image Restoration

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yang, Hao, Yang, Yan, Zhang, Ruikun, Pan, Liyuan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908735870337024
author Yang, Hao
Yang, Yan
Zhang, Ruikun
Pan, Liyuan
author_facet Yang, Hao
Yang, Yan
Zhang, Ruikun
Pan, Liyuan
contents Recent advances in OpenAI's GPT-series multimodal generation models have shown remarkable capabilities in producing visually compelling images. In this work, we investigate its potential impact on the image restoration community. We provide, to the best of our knowledge, the first systematic benchmark across diverse restoration scenarios. Our evaluation shows that, while the restoration results generated by GPT-Image models are often perceptually pleasant, they tend to lack pixel-level structural fidelity compared with ground-truth references. Typical deviations include changes in image geometry, object positions or counts, and even modifications in perspective. Beyond empirical observations, we further demonstrate that outputs from GPT-Image models can act as strong visual priors, offering notable performance improvements for existing restoration networks. Using dehazing, deraining, and low-light enhancement as representative case studies, we show that integrating GPT-generated priors significantly boosts restoration quality. This study not only provides practical insights and a baseline framework for incorporating GPT-based generative priors into restoration pipelines, but also highlights new opportunities for bridging image generation models and restoration tasks. To support future research, we will release GPT-restored results.
format Preprint
id arxiv_https___arxiv_org_abs_2505_05621
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Preliminary Study on GPT-Image Generation Model for Image Restoration
Yang, Hao
Yang, Yan
Zhang, Ruikun
Pan, Liyuan
Computer Vision and Pattern Recognition
Recent advances in OpenAI's GPT-series multimodal generation models have shown remarkable capabilities in producing visually compelling images. In this work, we investigate its potential impact on the image restoration community. We provide, to the best of our knowledge, the first systematic benchmark across diverse restoration scenarios. Our evaluation shows that, while the restoration results generated by GPT-Image models are often perceptually pleasant, they tend to lack pixel-level structural fidelity compared with ground-truth references. Typical deviations include changes in image geometry, object positions or counts, and even modifications in perspective. Beyond empirical observations, we further demonstrate that outputs from GPT-Image models can act as strong visual priors, offering notable performance improvements for existing restoration networks. Using dehazing, deraining, and low-light enhancement as representative case studies, we show that integrating GPT-generated priors significantly boosts restoration quality. This study not only provides practical insights and a baseline framework for incorporating GPT-based generative priors into restoration pipelines, but also highlights new opportunities for bridging image generation models and restoration tasks. To support future research, we will release GPT-restored results.
title A Preliminary Study on GPT-Image Generation Model for Image Restoration
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.05621