Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2412.14603 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910759867383808 |
|---|---|
| author | Ren, Zheng Zhou, Jingwen Zhang, Wenguan Yan, Jiapu Chen, Bingkun Feng, Huajun Chen, Shiqi |
| author_facet | Ren, Zheng Zhou, Jingwen Zhang, Wenguan Yan, Jiapu Chen, Bingkun Feng, Huajun Chen, Shiqi |
| contents | Recently, the joint design of optical systems and downstream algorithms is showing significant potential. However, existing rays-described methods are limited to optimizing geometric degradation, making it difficult to fully represent the optical characteristics of complex, miniaturized lenses constrained by wavefront aberration or diffraction effects. In this work, we introduce a precise optical simulation model, and every operation in pipeline is differentiable. This model employs a novel initial value strategy to enhance the reliability of intersection calculation on high aspherics. Moreover, it utilizes a differential operator to reduce memory consumption during coherent point spread function calculations. To efficiently address various degradation, we design a joint optimization procedure that leverages field information. Guided by a general restoration network, the proposed method not only enhances the image quality, but also successively improves the optical performance across multiple lenses that are already in professional level. This joint optimization pipeline offers innovative insights into the practical design of sophisticated optical systems and post-processing algorithms. The source code will be made publicly available at https://github.com/Zrr-ZJU/Successive-optimization |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_14603 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Successive optimization of optics and post-processing with differentiable coherent PSF operator and field information Ren, Zheng Zhou, Jingwen Zhang, Wenguan Yan, Jiapu Chen, Bingkun Feng, Huajun Chen, Shiqi Computer Vision and Pattern Recognition Optics Recently, the joint design of optical systems and downstream algorithms is showing significant potential. However, existing rays-described methods are limited to optimizing geometric degradation, making it difficult to fully represent the optical characteristics of complex, miniaturized lenses constrained by wavefront aberration or diffraction effects. In this work, we introduce a precise optical simulation model, and every operation in pipeline is differentiable. This model employs a novel initial value strategy to enhance the reliability of intersection calculation on high aspherics. Moreover, it utilizes a differential operator to reduce memory consumption during coherent point spread function calculations. To efficiently address various degradation, we design a joint optimization procedure that leverages field information. Guided by a general restoration network, the proposed method not only enhances the image quality, but also successively improves the optical performance across multiple lenses that are already in professional level. This joint optimization pipeline offers innovative insights into the practical design of sophisticated optical systems and post-processing algorithms. The source code will be made publicly available at https://github.com/Zrr-ZJU/Successive-optimization |
| title | Successive optimization of optics and post-processing with differentiable coherent PSF operator and field information |
| topic | Computer Vision and Pattern Recognition Optics |
| url | https://arxiv.org/abs/2412.14603 |