Ultra-low-light computer vision using trained photon correlations
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911589171462144 |
|---|---|
| author | Sohoni, Mandar M. Laydevant, Jérémie Ouellet, Mathieu Ma, Shi-Yuan Yanagimoto, Ryotatsu Ash, Benjamin A. Onodera, Tatsuhiro Wang, Tianyu Wright, Logan G. McMahon, Peter L. |
| author_facet | Sohoni, Mandar M. Laydevant, Jérémie Ouellet, Mathieu Ma, Shi-Yuan Yanagimoto, Ryotatsu Ash, Benjamin A. Onodera, Tatsuhiro Wang, Tianyu Wright, Logan G. McMahon, Peter L. |
| contents | Illumination using correlated photon sources has been established as an approach to allowing high-fidelity images to be reconstructed from noisy camera frames by taking advantage of the knowledge that signal photons are spatially correlated whereas detector clicks due to noise are uncorrelated. However, in computer-vision tasks, the goal is often not ultimately to reconstruct an image, but to make inferences about a scene -- such as what object is present. Here we show how correlated-photon illumination can be used to gain an advantage in a hybrid optical-electronic computer-vision pipeline for object recognition. We demonstrate correlation-aware training (CAT): end-to-end optimization of a trainable correlated-photon illumination source and a Transformer backend in a way that the Transformer can learn to benefit from the correlations, using a small number (<= 100) of shots. We show a classification accuracy enhancement of up to 15 percentage points over conventional, uncorrelated-illumination-based computer vision in ultra-low-light and noisy imaging conditions, as well as an improvement over using untrained correlated-photon illumination. Our work illustrates how specializing to a computer-vision task -- object recognition -- and training the pattern of photon correlations in conjunction with a digital backend allows us to push the limits of accuracy in highly photon-budget-constrained scenarios beyond existing methods focused on image reconstruction. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_11993 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Ultra-low-light computer vision using trained photon correlations Sohoni, Mandar M. Laydevant, Jérémie Ouellet, Mathieu Ma, Shi-Yuan Yanagimoto, Ryotatsu Ash, Benjamin A. Onodera, Tatsuhiro Wang, Tianyu Wright, Logan G. McMahon, Peter L. Computer Vision and Pattern Recognition Optics Illumination using correlated photon sources has been established as an approach to allowing high-fidelity images to be reconstructed from noisy camera frames by taking advantage of the knowledge that signal photons are spatially correlated whereas detector clicks due to noise are uncorrelated. However, in computer-vision tasks, the goal is often not ultimately to reconstruct an image, but to make inferences about a scene -- such as what object is present. Here we show how correlated-photon illumination can be used to gain an advantage in a hybrid optical-electronic computer-vision pipeline for object recognition. We demonstrate correlation-aware training (CAT): end-to-end optimization of a trainable correlated-photon illumination source and a Transformer backend in a way that the Transformer can learn to benefit from the correlations, using a small number (<= 100) of shots. We show a classification accuracy enhancement of up to 15 percentage points over conventional, uncorrelated-illumination-based computer vision in ultra-low-light and noisy imaging conditions, as well as an improvement over using untrained correlated-photon illumination. Our work illustrates how specializing to a computer-vision task -- object recognition -- and training the pattern of photon correlations in conjunction with a digital backend allows us to push the limits of accuracy in highly photon-budget-constrained scenarios beyond existing methods focused on image reconstruction. |
| title | Ultra-low-light computer vision using trained photon correlations |
| topic | Computer Vision and Pattern Recognition Optics |
| url | https://arxiv.org/abs/2604.11993 |