Quanta Video Restoration
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915021451165696 |
|---|---|
| author | Chennuri, Prateek Chi, Yiheng Jiang, Enze Godaliyadda, G. M. Dilshan Gnanasambandam, Abhiram Sheikh, Hamid R. Gyongy, Istvan Chan, Stanley H. |
| author_facet | Chennuri, Prateek Chi, Yiheng Jiang, Enze Godaliyadda, G. M. Dilshan Gnanasambandam, Abhiram Sheikh, Hamid R. Gyongy, Istvan Chan, Stanley H. |
| contents | The proliferation of single-photon image sensors has opened the door to a plethora of high-speed and low-light imaging applications. However, data collected by these sensors are often 1-bit or few-bit, and corrupted by noise and strong motion. Conventional video restoration methods are not designed to handle this situation, while specialized quanta burst algorithms have limited performance when the number of input frames is low. In this paper, we introduce Quanta Video Restoration (QUIVER), an end-to-end trainable network built on the core ideas of classical quanta restoration methods, i.e., pre-filtering, flow estimation, fusion, and refinement. We also collect and publish I2-2000FPS, a high-speed video dataset with the highest temporal resolution of 2000 frames-per-second, for training and testing. On simulated and real data, QUIVER outperforms existing quanta restoration methods by a significant margin. Code and dataset available at https://github.com/chennuriprateek/Quanta_Video_Restoration-QUIVER- |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_14994 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Quanta Video Restoration Chennuri, Prateek Chi, Yiheng Jiang, Enze Godaliyadda, G. M. Dilshan Gnanasambandam, Abhiram Sheikh, Hamid R. Gyongy, Istvan Chan, Stanley H. Image and Video Processing Computer Vision and Pattern Recognition The proliferation of single-photon image sensors has opened the door to a plethora of high-speed and low-light imaging applications. However, data collected by these sensors are often 1-bit or few-bit, and corrupted by noise and strong motion. Conventional video restoration methods are not designed to handle this situation, while specialized quanta burst algorithms have limited performance when the number of input frames is low. In this paper, we introduce Quanta Video Restoration (QUIVER), an end-to-end trainable network built on the core ideas of classical quanta restoration methods, i.e., pre-filtering, flow estimation, fusion, and refinement. We also collect and publish I2-2000FPS, a high-speed video dataset with the highest temporal resolution of 2000 frames-per-second, for training and testing. On simulated and real data, QUIVER outperforms existing quanta restoration methods by a significant margin. Code and dataset available at https://github.com/chennuriprateek/Quanta_Video_Restoration-QUIVER- |
| title | Quanta Video Restoration |
| topic | Image and Video Processing Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2410.14994 |