Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2406.04129 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911908505845760 |
|---|---|
| author | Cai, Xin Zhang, Hailong Wang, Chenchen Liu, Wentao Gu, Jinwei Xue, Tianfan |
| author_facet | Cai, Xin Zhang, Hailong Wang, Chenchen Liu, Wentao Gu, Jinwei Xue, Tianfan |
| contents | Lensless cameras, innovatively replacing traditional lenses for ultra-thin, flat optics, encode light directly onto sensors, producing images that are not immediately recognizable. This compact, lightweight, and cost-effective imaging solution offers inherent privacy advantages, making it attractive for privacy-sensitive applications like face verification. Typical lensless face verification adopts a two-stage process of reconstruction followed by verification, incurring privacy risks from reconstructed faces and high computational costs. This paper presents an end-to-end optimization approach for privacy-preserving face verification directly on encoded lensless captures, ensuring that the entire software pipeline remains encoded with no visible faces as intermediate results. To achieve this, we propose several techniques to address unique challenges from the lensless setup which precludes traditional face detection and alignment. Specifically, we propose a face center alignment scheme, an augmentation curriculum to build robustness against variations, and a knowledge distillation method to smooth optimization and enhance performance. Evaluations under both simulation and real environment demonstrate our method outperforms two-stage lensless verification while enhancing privacy and efficiency. Project website: \url{lenslessface.github.io}. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_04129 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | LenslessFace: An End-to-End Optimized Lensless System for Privacy-Preserving Face Verification Cai, Xin Zhang, Hailong Wang, Chenchen Liu, Wentao Gu, Jinwei Xue, Tianfan Computer Vision and Pattern Recognition Lensless cameras, innovatively replacing traditional lenses for ultra-thin, flat optics, encode light directly onto sensors, producing images that are not immediately recognizable. This compact, lightweight, and cost-effective imaging solution offers inherent privacy advantages, making it attractive for privacy-sensitive applications like face verification. Typical lensless face verification adopts a two-stage process of reconstruction followed by verification, incurring privacy risks from reconstructed faces and high computational costs. This paper presents an end-to-end optimization approach for privacy-preserving face verification directly on encoded lensless captures, ensuring that the entire software pipeline remains encoded with no visible faces as intermediate results. To achieve this, we propose several techniques to address unique challenges from the lensless setup which precludes traditional face detection and alignment. Specifically, we propose a face center alignment scheme, an augmentation curriculum to build robustness against variations, and a knowledge distillation method to smooth optimization and enhance performance. Evaluations under both simulation and real environment demonstrate our method outperforms two-stage lensless verification while enhancing privacy and efficiency. Project website: \url{lenslessface.github.io}. |
| title | LenslessFace: An End-to-End Optimized Lensless System for Privacy-Preserving Face Verification |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2406.04129 |