Ultra-High-Definition Reference-Based Landmark Image Super-Resolution with Generative Diffusion Prior

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shi, Zhenning, Yan, Zizheng, Yu, Yuhang, Xue, Clara, Zhuang, Jingyu, Zhang, Qi, Chen, Jinwei, Li, Tao, Fan, Qingnan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916899544104960
author Shi, Zhenning
Yan, Zizheng
Yu, Yuhang
Xue, Clara
Zhuang, Jingyu
Zhang, Qi
Chen, Jinwei
Li, Tao
Fan, Qingnan
author_facet Shi, Zhenning
Yan, Zizheng
Yu, Yuhang
Xue, Clara
Zhuang, Jingyu
Zhang, Qi
Chen, Jinwei
Li, Tao
Fan, Qingnan
contents Reference-based Image Super-Resolution (RefSR) aims to restore a low-resolution (LR) image by utilizing the semantic and texture information from an additional reference high-resolution (reference HR) image. Existing diffusion-based RefSR methods are typically built upon ControlNet, which struggles to effectively align the information between the LR image and the reference HR image. Moreover, current RefSR datasets suffer from limited resolution and poor image quality, resulting in the reference images lacking sufficient fine-grained details to support high-quality restoration. To overcome the limitations above, we propose TriFlowSR, a novel framework that explicitly achieves pattern matching between the LR image and the reference HR image. Meanwhile, we introduce Landmark-4K, the first RefSR dataset for Ultra-High-Definition (UHD) landmark scenarios. Considering the UHD scenarios with real-world degradation, in TriFlowSR, we design a Reference Matching Strategy to effectively match the LR image with the reference HR image. Experimental results show that our approach can better utilize the semantic and texture information of the reference HR image compared to previous methods. To the best of our knowledge, we propose the first diffusion-based RefSR pipeline for ultra-high definition landmark scenarios under real-world degradation. Our code and model will be available at https://github.com/nkicsl/TriFlowSR.
format Preprint
id arxiv_https___arxiv_org_abs_2508_10779
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Ultra-High-Definition Reference-Based Landmark Image Super-Resolution with Generative Diffusion Prior
Shi, Zhenning
Yan, Zizheng
Yu, Yuhang
Xue, Clara
Zhuang, Jingyu
Zhang, Qi
Chen, Jinwei
Li, Tao
Fan, Qingnan
Computer Vision and Pattern Recognition
Artificial Intelligence
Reference-based Image Super-Resolution (RefSR) aims to restore a low-resolution (LR) image by utilizing the semantic and texture information from an additional reference high-resolution (reference HR) image. Existing diffusion-based RefSR methods are typically built upon ControlNet, which struggles to effectively align the information between the LR image and the reference HR image. Moreover, current RefSR datasets suffer from limited resolution and poor image quality, resulting in the reference images lacking sufficient fine-grained details to support high-quality restoration. To overcome the limitations above, we propose TriFlowSR, a novel framework that explicitly achieves pattern matching between the LR image and the reference HR image. Meanwhile, we introduce Landmark-4K, the first RefSR dataset for Ultra-High-Definition (UHD) landmark scenarios. Considering the UHD scenarios with real-world degradation, in TriFlowSR, we design a Reference Matching Strategy to effectively match the LR image with the reference HR image. Experimental results show that our approach can better utilize the semantic and texture information of the reference HR image compared to previous methods. To the best of our knowledge, we propose the first diffusion-based RefSR pipeline for ultra-high definition landmark scenarios under real-world degradation. Our code and model will be available at https://github.com/nkicsl/TriFlowSR.
title Ultra-High-Definition Reference-Based Landmark Image Super-Resolution with Generative Diffusion Prior
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2508.10779