Super-Resolution on Rotationally Scanned Photoacoustic Microscopy Images Incorporating Scanning Prior

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Pan, Kai, Li, Linyang, Lin, Li, Cheng, Pujin, Lyu, Junyan, Xi, Lei, Tang, Xiaoyin
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915182498807808
author Pan, Kai
Li, Linyang
Lin, Li
Cheng, Pujin
Lyu, Junyan
Xi, Lei
Tang, Xiaoyin
author_facet Pan, Kai
Li, Linyang
Lin, Li
Cheng, Pujin
Lyu, Junyan
Xi, Lei
Tang, Xiaoyin
contents Photoacoustic Microscopy (PAM) images integrating the advantages of optical contrast and acoustic resolution have been widely used in brain studies. However, there exists a trade-off between scanning speed and image resolution. Compared with traditional raster scanning, rotational scanning provides good opportunities for fast PAM imaging by optimizing the scanning mechanism. Recently, there is a trend to incorporate deep learning into the scanning process to further increase the scanning speed.Yet, most such attempts are performed for raster scanning while those for rotational scanning are relatively rare. In this study, we propose a novel and well-performing super-resolution framework for rotational scanning-based PAM imaging. To eliminate adjacent rows' displacements due to subject motion or high-frequency scanning distortion,we introduce a registration module across odd and even rows in the preprocessing and incorporate displacement degradation in the training. Besides, gradient-based patch selection is proposed to increase the probability of blood vessel patches being selected for training. A Transformer-based network with a global receptive field is applied for better performance. Experimental results on both synthetic and real datasets demonstrate the effectiveness and generalizability of our proposed framework for rotationally scanned PAM images'super-resolution, both quantitatively and qualitatively. Code is available at https://github.com/11710615/PAMSR.git.
format Preprint
id arxiv_https___arxiv_org_abs_2312_07226
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Super-Resolution on Rotationally Scanned Photoacoustic Microscopy Images Incorporating Scanning Prior
Pan, Kai
Li, Linyang
Lin, Li
Cheng, Pujin
Lyu, Junyan
Xi, Lei
Tang, Xiaoyin
Image and Video Processing
Computer Vision and Pattern Recognition
Photoacoustic Microscopy (PAM) images integrating the advantages of optical contrast and acoustic resolution have been widely used in brain studies. However, there exists a trade-off between scanning speed and image resolution. Compared with traditional raster scanning, rotational scanning provides good opportunities for fast PAM imaging by optimizing the scanning mechanism. Recently, there is a trend to incorporate deep learning into the scanning process to further increase the scanning speed.Yet, most such attempts are performed for raster scanning while those for rotational scanning are relatively rare. In this study, we propose a novel and well-performing super-resolution framework for rotational scanning-based PAM imaging. To eliminate adjacent rows' displacements due to subject motion or high-frequency scanning distortion,we introduce a registration module across odd and even rows in the preprocessing and incorporate displacement degradation in the training. Besides, gradient-based patch selection is proposed to increase the probability of blood vessel patches being selected for training. A Transformer-based network with a global receptive field is applied for better performance. Experimental results on both synthetic and real datasets demonstrate the effectiveness and generalizability of our proposed framework for rotationally scanned PAM images'super-resolution, both quantitatively and qualitatively. Code is available at https://github.com/11710615/PAMSR.git.
title Super-Resolution on Rotationally Scanned Photoacoustic Microscopy Images Incorporating Scanning Prior
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2312.07226