Recording dynamic facial micro-expressions with a multi-focus camera array
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866929681392992256 |
|---|---|
| author | Kreiss, Lucas Tang, Weiheng Balla, Ramana Yang, Xi Chaware, Amey Kim, Kanghyun Cook, Clare B. Begue, Aurelien Dugo, Clay Harfouche, Mark Zhou, Kevin C. Horstmeyer, Roarke |
| author_facet | Kreiss, Lucas Tang, Weiheng Balla, Ramana Yang, Xi Chaware, Amey Kim, Kanghyun Cook, Clare B. Begue, Aurelien Dugo, Clay Harfouche, Mark Zhou, Kevin C. Horstmeyer, Roarke |
| contents | We present an approach of utilizing a multi-camera array system for capturing dynamic high-resolution videos of the human face, with improved imaging performance as compared to traditional single-camera configurations. Employing an array of 54 individual high-resolution cameras, each with its own 13 megapixel sensor (709 megapixels total), we uniquely focus each camera to a different plane across the curved surface of the human face in order to capture dynamic facial expressions. Post-processing methods then stitch together each synchronized set of 54 images into a composite video frame. Our multi-focus strategy overcomes the resolution and depth-of-field (DOF) limitations for capturing macroscopically curved surfaces such as the human face, while maintaining high lateral resolution. Specifically we demonstrate how our setup achieves a generally uniform lateral resolution of 26.75 +/- 8.8 micrometer across a composite DOF of ~43mm that covers the entire face (85 cm^2 + FOV). Compared to a single-focus configuration this is almost a 10-fold increase in effective DOF. We believe that our new approach for multi-focus camera array video sets the stage for future video capture of a variety of dynamic and macroscopically curved surfaces at microscopic resolution. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_01973 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Recording dynamic facial micro-expressions with a multi-focus camera array Kreiss, Lucas Tang, Weiheng Balla, Ramana Yang, Xi Chaware, Amey Kim, Kanghyun Cook, Clare B. Begue, Aurelien Dugo, Clay Harfouche, Mark Zhou, Kevin C. Horstmeyer, Roarke Optics We present an approach of utilizing a multi-camera array system for capturing dynamic high-resolution videos of the human face, with improved imaging performance as compared to traditional single-camera configurations. Employing an array of 54 individual high-resolution cameras, each with its own 13 megapixel sensor (709 megapixels total), we uniquely focus each camera to a different plane across the curved surface of the human face in order to capture dynamic facial expressions. Post-processing methods then stitch together each synchronized set of 54 images into a composite video frame. Our multi-focus strategy overcomes the resolution and depth-of-field (DOF) limitations for capturing macroscopically curved surfaces such as the human face, while maintaining high lateral resolution. Specifically we demonstrate how our setup achieves a generally uniform lateral resolution of 26.75 +/- 8.8 micrometer across a composite DOF of ~43mm that covers the entire face (85 cm^2 + FOV). Compared to a single-focus configuration this is almost a 10-fold increase in effective DOF. We believe that our new approach for multi-focus camera array video sets the stage for future video capture of a variety of dynamic and macroscopically curved surfaces at microscopic resolution. |
| title | Recording dynamic facial micro-expressions with a multi-focus camera array |
| topic | Optics |
| url | https://arxiv.org/abs/2410.01973 |