A Systematic Investigation on Deep Learning-Based Omnidirectional Image and Video Super-Resolution

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhao, Qianqian, Guo, Chunle, Zhang, Tianyi, Zhang, Junpei, Jia, Peiyang, Su, Tan, Jiang, Wenjie, Li, Chongyi
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918049733410816
author Zhao, Qianqian
Guo, Chunle
Zhang, Tianyi
Zhang, Junpei
Jia, Peiyang
Su, Tan
Jiang, Wenjie
Li, Chongyi
author_facet Zhao, Qianqian
Guo, Chunle
Zhang, Tianyi
Zhang, Junpei
Jia, Peiyang
Su, Tan
Jiang, Wenjie
Li, Chongyi
contents Omnidirectional image and video super-resolution is a crucial research topic in low-level vision, playing an essential role in virtual reality and augmented reality applications. Its goal is to reconstruct high-resolution images or video frames from low-resolution inputs, thereby enhancing detail preservation and enabling more accurate scene analysis and interpretation. In recent years, numerous innovative and effective approaches have been proposed, predominantly based on deep learning techniques, involving diverse network architectures, loss functions, projection strategies, and training datasets. This paper presents a systematic review of recent progress in omnidirectional image and video super-resolution, focusing on deep learning-based methods. Given that existing datasets predominantly rely on synthetic degradation and fall short in capturing real-world distortions, we introduce a new dataset, 360Insta, that comprises authentically degraded omnidirectional images and videos collected under diverse conditions, including varying lighting, motion, and exposure settings. This dataset addresses a critical gap in current omnidirectional benchmarks and enables more robust evaluation of the generalization capabilities of omnidirectional super-resolution methods. We conduct comprehensive qualitative and quantitative evaluations of existing methods on both public datasets and our proposed dataset. Furthermore, we provide a systematic overview of the current status of research and discuss promising directions for future exploration. All datasets, methods, and evaluation metrics introduced in this work are publicly available and will be regularly updated. Project page: https://github.com/nqian1/Survey-on-ODISR-and-ODVSR.
format Preprint
id arxiv_https___arxiv_org_abs_2506_06710
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Systematic Investigation on Deep Learning-Based Omnidirectional Image and Video Super-Resolution
Zhao, Qianqian
Guo, Chunle
Zhang, Tianyi
Zhang, Junpei
Jia, Peiyang
Su, Tan
Jiang, Wenjie
Li, Chongyi
Computer Vision and Pattern Recognition
Image and Video Processing
Omnidirectional image and video super-resolution is a crucial research topic in low-level vision, playing an essential role in virtual reality and augmented reality applications. Its goal is to reconstruct high-resolution images or video frames from low-resolution inputs, thereby enhancing detail preservation and enabling more accurate scene analysis and interpretation. In recent years, numerous innovative and effective approaches have been proposed, predominantly based on deep learning techniques, involving diverse network architectures, loss functions, projection strategies, and training datasets. This paper presents a systematic review of recent progress in omnidirectional image and video super-resolution, focusing on deep learning-based methods. Given that existing datasets predominantly rely on synthetic degradation and fall short in capturing real-world distortions, we introduce a new dataset, 360Insta, that comprises authentically degraded omnidirectional images and videos collected under diverse conditions, including varying lighting, motion, and exposure settings. This dataset addresses a critical gap in current omnidirectional benchmarks and enables more robust evaluation of the generalization capabilities of omnidirectional super-resolution methods. We conduct comprehensive qualitative and quantitative evaluations of existing methods on both public datasets and our proposed dataset. Furthermore, we provide a systematic overview of the current status of research and discuss promising directions for future exploration. All datasets, methods, and evaluation metrics introduced in this work are publicly available and will be regularly updated. Project page: https://github.com/nqian1/Survey-on-ODISR-and-ODVSR.
title A Systematic Investigation on Deep Learning-Based Omnidirectional Image and Video Super-Resolution
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2506.06710