Multimodal Biometric Authentication Using Camera-Based PPG and Fingerprint Fusion
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915053117112320 |
|---|---|
| author | Zheng, Xue Xian Rahma, M. M. Ur Taha, Bilal Masood, Mudassir Hatzinakos, Dimitrios Al-Naffouri, Tareq |
| author_facet | Zheng, Xue Xian Rahma, M. M. Ur Taha, Bilal Masood, Mudassir Hatzinakos, Dimitrios Al-Naffouri, Tareq |
| contents | Camera-based photoplethysmography (PPG) obtained from smartphones has shown great promise for personalized healthcare and secure authentication. This paper presents a multimodal biometric system that integrates PPG signals extracted from videos with fingerprint data to enhance the accuracy of user verification. The system requires users to place their fingertip on the camera lens for a few seconds, allowing the capture and processing of unique biometric characteristics. Our approach employs a neural network with two structured state-space model (SSM) encoders to manage the distinct modalities. Fingerprint images are transformed into pixel sequences, and along with segmented PPG waveforms, they are input into the encoders. A cross-modal attention mechanism then extracts refined feature representations, and a distribution-oriented contrastive loss function aligns these features within a unified latent space. Experimental results demonstrate the system's superior performance across various evaluation metrics in both single-session and dual-session authentication scenarios. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_05660 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Multimodal Biometric Authentication Using Camera-Based PPG and Fingerprint Fusion Zheng, Xue Xian Rahma, M. M. Ur Taha, Bilal Masood, Mudassir Hatzinakos, Dimitrios Al-Naffouri, Tareq Computer Vision and Pattern Recognition Camera-based photoplethysmography (PPG) obtained from smartphones has shown great promise for personalized healthcare and secure authentication. This paper presents a multimodal biometric system that integrates PPG signals extracted from videos with fingerprint data to enhance the accuracy of user verification. The system requires users to place their fingertip on the camera lens for a few seconds, allowing the capture and processing of unique biometric characteristics. Our approach employs a neural network with two structured state-space model (SSM) encoders to manage the distinct modalities. Fingerprint images are transformed into pixel sequences, and along with segmented PPG waveforms, they are input into the encoders. A cross-modal attention mechanism then extracts refined feature representations, and a distribution-oriented contrastive loss function aligns these features within a unified latent space. Experimental results demonstrate the system's superior performance across various evaluation metrics in both single-session and dual-session authentication scenarios. |
| title | Multimodal Biometric Authentication Using Camera-Based PPG and Fingerprint Fusion |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2412.05660 |