DRACO: A Denoising-Reconstruction Autoencoder for Cryo-EM

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Shen, Yingjun, Dai, Haizhao, Chen, Qihe, Zeng, Yan, Zhang, Jiakai, Pei, Yuan, Yu, Jingyi
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929561996886016
author Shen, Yingjun
Dai, Haizhao
Chen, Qihe
Zeng, Yan
Zhang, Jiakai
Pei, Yuan
Yu, Jingyi
author_facet Shen, Yingjun
Dai, Haizhao
Chen, Qihe
Zeng, Yan
Zhang, Jiakai
Pei, Yuan
Yu, Jingyi
contents Foundation models in computer vision have demonstrated exceptional performance in zero-shot and few-shot tasks by extracting multi-purpose features from large-scale datasets through self-supervised pre-training methods. However, these models often overlook the severe corruption in cryogenic electron microscopy (cryo-EM) images by high-level noises. We introduce DRACO, a Denoising-Reconstruction Autoencoder for CryO-EM, inspired by the Noise2Noise (N2N) approach. By processing cryo-EM movies into odd and even images and treating them as independent noisy observations, we apply a denoising-reconstruction hybrid training scheme. We mask both images to create denoising and reconstruction tasks. For DRACO's pre-training, the quality of the dataset is essential, we hence build a high-quality, diverse dataset from an uncurated public database, including over 270,000 movies or micrographs. After pre-training, DRACO naturally serves as a generalizable cryo-EM image denoiser and a foundation model for various cryo-EM downstream tasks. DRACO demonstrates the best performance in denoising, micrograph curation, and particle picking tasks compared to state-of-the-art baselines.
format Preprint
id arxiv_https___arxiv_org_abs_2410_11373
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle DRACO: A Denoising-Reconstruction Autoencoder for Cryo-EM
Shen, Yingjun
Dai, Haizhao
Chen, Qihe
Zeng, Yan
Zhang, Jiakai
Pei, Yuan
Yu, Jingyi
Computer Vision and Pattern Recognition
Image and Video Processing
Foundation models in computer vision have demonstrated exceptional performance in zero-shot and few-shot tasks by extracting multi-purpose features from large-scale datasets through self-supervised pre-training methods. However, these models often overlook the severe corruption in cryogenic electron microscopy (cryo-EM) images by high-level noises. We introduce DRACO, a Denoising-Reconstruction Autoencoder for CryO-EM, inspired by the Noise2Noise (N2N) approach. By processing cryo-EM movies into odd and even images and treating them as independent noisy observations, we apply a denoising-reconstruction hybrid training scheme. We mask both images to create denoising and reconstruction tasks. For DRACO's pre-training, the quality of the dataset is essential, we hence build a high-quality, diverse dataset from an uncurated public database, including over 270,000 movies or micrographs. After pre-training, DRACO naturally serves as a generalizable cryo-EM image denoiser and a foundation model for various cryo-EM downstream tasks. DRACO demonstrates the best performance in denoising, micrograph curation, and particle picking tasks compared to state-of-the-art baselines.
title DRACO: A Denoising-Reconstruction Autoencoder for Cryo-EM
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2410.11373