Finding Nano-Ötzi: Semi-Supervised Volume Visualization for Cryo-Electron Tomography

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Nguyen, Ngan, Bohak, Ciril, Engel, Dominik, Mindek, Peter, Strnad, Ondřej, Wonka, Peter, Li, Sai, Ropinski, Timo, Viola, Ivan
Format: Preprint
Publié: 2021
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910074219266048
author Nguyen, Ngan
Bohak, Ciril
Engel, Dominik
Mindek, Peter
Strnad, Ondřej
Wonka, Peter
Li, Sai
Ropinski, Timo
Viola, Ivan
author_facet Nguyen, Ngan
Bohak, Ciril
Engel, Dominik
Mindek, Peter
Strnad, Ondřej
Wonka, Peter
Li, Sai
Ropinski, Timo
Viola, Ivan
contents Cryo-Electron Tomography (cryo-ET) is a new 3D imaging technique with unprecedented potential for resolving submicron structural detail. Existing volume visualization methods, however, cannot cope with its very low signal-to-noise ratio. In order to design more powerful transfer functions, we propose to leverage soft segmentation as an explicit component of visualization for noisy volumes. Our technical realization is based on semi-supervised learning where we combine the advantages of two segmentation algorithms. A first weak segmentation algorithm provides good results for propagating sparse user provided labels to other voxels in the same volume. This weak segmentation algorithm is used to generate dense pseudo labels. A second powerful deep-learning based segmentation algorithm can learn from these pseudo labels to generalize the segmentation to other unseen volumes, a task that the weak segmentation algorithm fails at completely. The proposed volume visualization uses the deep-learning based segmentation as a component for segmentation-aware transfer function design. Appropriate ramp parameters can be suggested automatically through histogram analysis. Finally, our visualization uses gradient-free ambient occlusion shading to further suppress visual presence of noise, and to give structural detail desired prominence. The cryo-ET data studied throughout our technical experiments is based on the highest-quality tilted series of intact SARS-CoV-2 virions. Our technique shows the high impact in target sciences for visual data analysis of very noisy volumes that cannot be visualized with existing techniques.
format Preprint
id arxiv_https___arxiv_org_abs_2104_01554
institution arXiv
publishDate 2021
record_format arxiv
spellingShingle Finding Nano-Ötzi: Semi-Supervised Volume Visualization for Cryo-Electron Tomography
Nguyen, Ngan
Bohak, Ciril
Engel, Dominik
Mindek, Peter
Strnad, Ondřej
Wonka, Peter
Li, Sai
Ropinski, Timo
Viola, Ivan
Quantitative Methods
Cryo-Electron Tomography (cryo-ET) is a new 3D imaging technique with unprecedented potential for resolving submicron structural detail. Existing volume visualization methods, however, cannot cope with its very low signal-to-noise ratio. In order to design more powerful transfer functions, we propose to leverage soft segmentation as an explicit component of visualization for noisy volumes. Our technical realization is based on semi-supervised learning where we combine the advantages of two segmentation algorithms. A first weak segmentation algorithm provides good results for propagating sparse user provided labels to other voxels in the same volume. This weak segmentation algorithm is used to generate dense pseudo labels. A second powerful deep-learning based segmentation algorithm can learn from these pseudo labels to generalize the segmentation to other unseen volumes, a task that the weak segmentation algorithm fails at completely. The proposed volume visualization uses the deep-learning based segmentation as a component for segmentation-aware transfer function design. Appropriate ramp parameters can be suggested automatically through histogram analysis. Finally, our visualization uses gradient-free ambient occlusion shading to further suppress visual presence of noise, and to give structural detail desired prominence. The cryo-ET data studied throughout our technical experiments is based on the highest-quality tilted series of intact SARS-CoV-2 virions. Our technique shows the high impact in target sciences for visual data analysis of very noisy volumes that cannot be visualized with existing techniques.
title Finding Nano-Ötzi: Semi-Supervised Volume Visualization for Cryo-Electron Tomography
topic Quantitative Methods
url https://arxiv.org/abs/2104.01554