i-FlatCam: A 253 FPS, 91.49 $μ$J/Frame Ultra-Compact Intelligent Lensless Camera for Real-Time and Efficient Eye Tracking in VR/AR
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2022
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866913762856927232 |
|---|---|
| author | Zhao, Yang Li, Ziyun Fu, Yonggan Zhang, Yongan Li, Chaojian Wan, Cheng You, Haoran Wu, Shang Ouyang, Xu Boominathan, Vivek Veeraraghavan, Ashok Lin, Yingyan Celine |
| author_facet | Zhao, Yang Li, Ziyun Fu, Yonggan Zhang, Yongan Li, Chaojian Wan, Cheng You, Haoran Wu, Shang Ouyang, Xu Boominathan, Vivek Veeraraghavan, Ashok Lin, Yingyan Celine |
| contents | We present a first-of-its-kind ultra-compact intelligent camera system, dubbed i-FlatCam, including a lensless camera with a computational (Comp.) chip. It highlights (1) a predict-then-focus eye tracking pipeline for boosted efficiency without compromising the accuracy, (2) a unified compression scheme for single-chip processing and improved frame rate per second (FPS), and (3) dedicated intra-channel reuse design for depth-wise convolutional layers (DW-CONV) to increase utilization. i-FlatCam demonstrates the first eye tracking pipeline with a lensless camera and achieves 3.16 degrees of accuracy, 253 FPS, 91.49 $μ$J/Frame, and 6.7mm x 8.9mm x 1.2mm camera form factor, paving the way for next-generation Augmented Reality (AR) and Virtual Reality (VR) devices. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2206_08141 |
| institution | arXiv |
| publishDate | 2022 |
| record_format | arxiv |
| spellingShingle | i-FlatCam: A 253 FPS, 91.49 $μ$J/Frame Ultra-Compact Intelligent Lensless Camera for Real-Time and Efficient Eye Tracking in VR/AR Zhao, Yang Li, Ziyun Fu, Yonggan Zhang, Yongan Li, Chaojian Wan, Cheng You, Haoran Wu, Shang Ouyang, Xu Boominathan, Vivek Veeraraghavan, Ashok Lin, Yingyan Celine Hardware Architecture We present a first-of-its-kind ultra-compact intelligent camera system, dubbed i-FlatCam, including a lensless camera with a computational (Comp.) chip. It highlights (1) a predict-then-focus eye tracking pipeline for boosted efficiency without compromising the accuracy, (2) a unified compression scheme for single-chip processing and improved frame rate per second (FPS), and (3) dedicated intra-channel reuse design for depth-wise convolutional layers (DW-CONV) to increase utilization. i-FlatCam demonstrates the first eye tracking pipeline with a lensless camera and achieves 3.16 degrees of accuracy, 253 FPS, 91.49 $μ$J/Frame, and 6.7mm x 8.9mm x 1.2mm camera form factor, paving the way for next-generation Augmented Reality (AR) and Virtual Reality (VR) devices. |
| title | i-FlatCam: A 253 FPS, 91.49 $μ$J/Frame Ultra-Compact Intelligent Lensless Camera for Real-Time and Efficient Eye Tracking in VR/AR |
| topic | Hardware Architecture |
| url | https://arxiv.org/abs/2206.08141 |