Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.17377 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909359189000192 |
|---|---|
| author | Nakahata, Ryuma Zaman, Shehtab Zhang, Mingyuan Lu, Fake Chiu, Kenneth |
| author_facet | Nakahata, Ryuma Zaman, Shehtab Zhang, Mingyuan Lu, Fake Chiu, Kenneth |
| contents | Ptychography is a computational method of microscopy that recovers high-resolution transmission images of samples from a series of diffraction patterns. While conventional phase retrieval algorithms can iteratively recover the images, they require oversampled diffraction patterns, incur significant computational costs, and struggle to recover the absolute phase of the sample's transmission function. Deep learning algorithms for ptychography are a promising approach to resolving the limitations of iterative algorithms. We present PtychoFormer, a hierarchical transformer-based model for data-driven single-shot ptychographic phase retrieval. PtychoFormer processes subsets of diffraction patterns, generating local inferences that are seamlessly stitched together to produce a high-quality reconstruction. Our model exhibits tolerance to sparsely scanned diffraction patterns and achieves up to 3600 times faster imaging speed than the extended ptychographic iterative engine (ePIE). We also propose the extended-PtychoFormer (ePF), a hybrid approach that combines the benefits of PtychoFormer with the ePIE. ePF minimizes global phase shifts and significantly enhances reconstruction quality, achieving state-of-the-art phase retrieval in ptychography. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_17377 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | PtychoFormer: A Transformer-based Model for Ptychographic Phase Retrieval Nakahata, Ryuma Zaman, Shehtab Zhang, Mingyuan Lu, Fake Chiu, Kenneth Image and Video Processing Computer Vision and Pattern Recognition I.2.10; I.5.4 Ptychography is a computational method of microscopy that recovers high-resolution transmission images of samples from a series of diffraction patterns. While conventional phase retrieval algorithms can iteratively recover the images, they require oversampled diffraction patterns, incur significant computational costs, and struggle to recover the absolute phase of the sample's transmission function. Deep learning algorithms for ptychography are a promising approach to resolving the limitations of iterative algorithms. We present PtychoFormer, a hierarchical transformer-based model for data-driven single-shot ptychographic phase retrieval. PtychoFormer processes subsets of diffraction patterns, generating local inferences that are seamlessly stitched together to produce a high-quality reconstruction. Our model exhibits tolerance to sparsely scanned diffraction patterns and achieves up to 3600 times faster imaging speed than the extended ptychographic iterative engine (ePIE). We also propose the extended-PtychoFormer (ePF), a hybrid approach that combines the benefits of PtychoFormer with the ePIE. ePF minimizes global phase shifts and significantly enhances reconstruction quality, achieving state-of-the-art phase retrieval in ptychography. |
| title | PtychoFormer: A Transformer-based Model for Ptychographic Phase Retrieval |
| topic | Image and Video Processing Computer Vision and Pattern Recognition I.2.10; I.5.4 |
| url | https://arxiv.org/abs/2410.17377 |