Image Super-Resolution Using T-Tetromino Pixels

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Grosche, Simon, Regensky, Andy, Seiler, Jürgen, Kaup, André
Formato: Preprint
Publicado: 2021
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909365481504768
author Grosche, Simon
Regensky, Andy
Seiler, Jürgen
Kaup, André
author_facet Grosche, Simon
Regensky, Andy
Seiler, Jürgen
Kaup, André
contents For modern high-resolution imaging sensors, pixel binning is performed in low-lighting conditions and in case high frame rates are required. To recover the original spatial resolution, single-image super-resolution techniques can be applied for upscaling. To achieve a higher image quality after upscaling, we propose a novel binning concept using tetromino-shaped pixels. It is embedded into the field of compressed sensing and the coherence is calculated to motivate the sensor layouts used. Next, we investigate the reconstruction quality using tetromino pixels for the first time in literature. Instead of using different types of tetrominoes as proposed elsewhere, we show that using a small repeating cell consisting of only four T-tetrominoes is sufficient. For reconstruction, we use a locally fully connected reconstruction (LFCR) network as well as two classical reconstruction methods from the field of compressed sensing. Using the LFCR network in combination with the proposed tetromino layout, we achieve superior image quality in terms of PSNR, SSIM, and visually compared to conventional single-image super-resolution using the very deep super-resolution (VDSR) network. For PSNR, a gain of up to \SI[retain-explicit-plus]{+1.92}{dB} is achieved.
format Preprint
id arxiv_https___arxiv_org_abs_2111_09013
institution arXiv
publishDate 2021
record_format arxiv
spellingShingle Image Super-Resolution Using T-Tetromino Pixels
Grosche, Simon
Regensky, Andy
Seiler, Jürgen
Kaup, André
Image and Video Processing
Computer Vision and Pattern Recognition
For modern high-resolution imaging sensors, pixel binning is performed in low-lighting conditions and in case high frame rates are required. To recover the original spatial resolution, single-image super-resolution techniques can be applied for upscaling. To achieve a higher image quality after upscaling, we propose a novel binning concept using tetromino-shaped pixels. It is embedded into the field of compressed sensing and the coherence is calculated to motivate the sensor layouts used. Next, we investigate the reconstruction quality using tetromino pixels for the first time in literature. Instead of using different types of tetrominoes as proposed elsewhere, we show that using a small repeating cell consisting of only four T-tetrominoes is sufficient. For reconstruction, we use a locally fully connected reconstruction (LFCR) network as well as two classical reconstruction methods from the field of compressed sensing. Using the LFCR network in combination with the proposed tetromino layout, we achieve superior image quality in terms of PSNR, SSIM, and visually compared to conventional single-image super-resolution using the very deep super-resolution (VDSR) network. For PSNR, a gain of up to \SI[retain-explicit-plus]{+1.92}{dB} is achieved.
title Image Super-Resolution Using T-Tetromino Pixels
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2111.09013