FakET: Simulating Cryo-Electron Tomograms with Neural Style Transfer

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Harar, Pavol, Herrmann, Lukas, Grohs, Philipp, Haselbach, David
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929719560110080
author Harar, Pavol
Herrmann, Lukas
Grohs, Philipp
Haselbach, David
author_facet Harar, Pavol
Herrmann, Lukas
Grohs, Philipp
Haselbach, David
contents In cryo-electron microscopy, accurate particle localization and classification are imperative. Recent deep learning solutions, though successful, require extensive training data sets. The protracted generation time of physics-based models, often employed to produce these data sets, limits their broad applicability. We introduce FakET, a method based on Neural Style Transfer, capable of simulating the forward operator of any cryo transmission electron microscope. It can be used to adapt a synthetic training data set according to reference data producing high-quality simulated micrographs or tilt-series. To assess the quality of our generated data, we used it to train a state-of-the-art localization and classification architecture and compared its performance with a counterpart trained on benchmark data. Remarkably, our technique matches the performance, boosts data generation speed 750 times, uses 33 times less memory, and scales well to typical transmission electron microscope detector sizes. It leverages GPU acceleration and parallel processing. The source code is available at https://github.com/paloha/faket.
format Preprint
id arxiv_https___arxiv_org_abs_2304_02011
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle FakET: Simulating Cryo-Electron Tomograms with Neural Style Transfer
Harar, Pavol
Herrmann, Lukas
Grohs, Philipp
Haselbach, David
Machine Learning
Image and Video Processing
Quantitative Methods
In cryo-electron microscopy, accurate particle localization and classification are imperative. Recent deep learning solutions, though successful, require extensive training data sets. The protracted generation time of physics-based models, often employed to produce these data sets, limits their broad applicability. We introduce FakET, a method based on Neural Style Transfer, capable of simulating the forward operator of any cryo transmission electron microscope. It can be used to adapt a synthetic training data set according to reference data producing high-quality simulated micrographs or tilt-series. To assess the quality of our generated data, we used it to train a state-of-the-art localization and classification architecture and compared its performance with a counterpart trained on benchmark data. Remarkably, our technique matches the performance, boosts data generation speed 750 times, uses 33 times less memory, and scales well to typical transmission electron microscope detector sizes. It leverages GPU acceleration and parallel processing. The source code is available at https://github.com/paloha/faket.
title FakET: Simulating Cryo-Electron Tomograms with Neural Style Transfer
topic Machine Learning
Image and Video Processing
Quantitative Methods
url https://arxiv.org/abs/2304.02011