Rethinking Image Super-Resolution from Training Data Perspectives

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ohtani, Go, Tadokoro, Ryu, Yamada, Ryosuke, Asano, Yuki M., Laina, Iro, Rupprecht, Christian, Inoue, Nakamasa, Yokota, Rio, Kataoka, Hirokatsu, Aoki, Yoshimitsu
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916377305022464
author Ohtani, Go
Tadokoro, Ryu
Yamada, Ryosuke
Asano, Yuki M.
Laina, Iro
Rupprecht, Christian
Inoue, Nakamasa
Yokota, Rio
Kataoka, Hirokatsu
Aoki, Yoshimitsu
author_facet Ohtani, Go
Tadokoro, Ryu
Yamada, Ryosuke
Asano, Yuki M.
Laina, Iro
Rupprecht, Christian
Inoue, Nakamasa
Yokota, Rio
Kataoka, Hirokatsu
Aoki, Yoshimitsu
contents In this work, we investigate the understudied effect of the training data used for image super-resolution (SR). Most commonly, novel SR methods are developed and benchmarked on common training datasets such as DIV2K and DF2K. However, we investigate and rethink the training data from the perspectives of diversity and quality, {thereby addressing the question of ``How important is SR training for SR models?''}. To this end, we propose an automated image evaluation pipeline. With this, we stratify existing high-resolution image datasets and larger-scale image datasets such as ImageNet and PASS to compare their performances. We find that datasets with (i) low compression artifacts, (ii) high within-image diversity as judged by the number of different objects, and (iii) a large number of images from ImageNet or PASS all positively affect SR performance. We hope that the proposed simple-yet-effective dataset curation pipeline will inform the construction of SR datasets in the future and yield overall better models.
format Preprint
id arxiv_https___arxiv_org_abs_2409_00768
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Rethinking Image Super-Resolution from Training Data Perspectives
Ohtani, Go
Tadokoro, Ryu
Yamada, Ryosuke
Asano, Yuki M.
Laina, Iro
Rupprecht, Christian
Inoue, Nakamasa
Yokota, Rio
Kataoka, Hirokatsu
Aoki, Yoshimitsu
Computer Vision and Pattern Recognition
In this work, we investigate the understudied effect of the training data used for image super-resolution (SR). Most commonly, novel SR methods are developed and benchmarked on common training datasets such as DIV2K and DF2K. However, we investigate and rethink the training data from the perspectives of diversity and quality, {thereby addressing the question of ``How important is SR training for SR models?''}. To this end, we propose an automated image evaluation pipeline. With this, we stratify existing high-resolution image datasets and larger-scale image datasets such as ImageNet and PASS to compare their performances. We find that datasets with (i) low compression artifacts, (ii) high within-image diversity as judged by the number of different objects, and (iii) a large number of images from ImageNet or PASS all positively affect SR performance. We hope that the proposed simple-yet-effective dataset curation pipeline will inform the construction of SR datasets in the future and yield overall better models.
title Rethinking Image Super-Resolution from Training Data Perspectives
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2409.00768