M3PD Dataset: Dual-view Photoplethysmography (PPG) Using Front-and-rear Cameras of Smartphones in Lab and Clinical Settings

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Tang, Jiankai, Zhang, Tao, Li, Jia, Zhang, Yiru, Zhang, Mingyu, Wang, Kegang, Hao, Yuming, Wang, Bolin, Li, Haiyang, Wang, Xingyao, Shi, Yuanchun, Wang, Yuntao, Qian, Sichong
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915595490951168
author Tang, Jiankai
Zhang, Tao
Li, Jia
Zhang, Yiru
Zhang, Mingyu
Wang, Kegang
Hao, Yuming
Wang, Bolin
Li, Haiyang
Wang, Xingyao
Shi, Yuanchun
Wang, Yuntao
Qian, Sichong
author_facet Tang, Jiankai
Zhang, Tao
Li, Jia
Zhang, Yiru
Zhang, Mingyu
Wang, Kegang
Hao, Yuming
Wang, Bolin
Li, Haiyang
Wang, Xingyao
Shi, Yuanchun
Wang, Yuntao
Qian, Sichong
contents Portable physiological monitoring is essential for early detection and management of cardiovascular disease, but current methods often require specialized equipment that limits accessibility or impose impractical postures that patients cannot maintain. Video-based photoplethysmography on smartphones offers a convenient noninvasive alternative, yet it still faces reliability challenges caused by motion artifacts, lighting variations, and single-view constraints. Few studies have demonstrated reliable application to cardiovascular patients, and no widely used open datasets exist for cross-device accuracy. To address these limitations, we introduce the M3PD dataset, the first publicly available dual-view mobile photoplethysmography dataset, comprising synchronized facial and fingertip videos captured simultaneously via front and rear smartphone cameras from 60 participants (including 47 cardiovascular patients). Building on this dual-view setting, we further propose F3Mamba, which fuses the facial and fingertip views through Mamba-based temporal modeling. The model reduces heart-rate error by 21.9 to 30.2 percent over existing single-view baselines while improving robustness in challenging real-world scenarios. Data and code: https://github.com/Health-HCI-Group/F3Mamba.
format Preprint
id arxiv_https___arxiv_org_abs_2511_02349
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle M3PD Dataset: Dual-view Photoplethysmography (PPG) Using Front-and-rear Cameras of Smartphones in Lab and Clinical Settings
Tang, Jiankai
Zhang, Tao
Li, Jia
Zhang, Yiru
Zhang, Mingyu
Wang, Kegang
Hao, Yuming
Wang, Bolin
Li, Haiyang
Wang, Xingyao
Shi, Yuanchun
Wang, Yuntao
Qian, Sichong
Computer Vision and Pattern Recognition
Portable physiological monitoring is essential for early detection and management of cardiovascular disease, but current methods often require specialized equipment that limits accessibility or impose impractical postures that patients cannot maintain. Video-based photoplethysmography on smartphones offers a convenient noninvasive alternative, yet it still faces reliability challenges caused by motion artifacts, lighting variations, and single-view constraints. Few studies have demonstrated reliable application to cardiovascular patients, and no widely used open datasets exist for cross-device accuracy. To address these limitations, we introduce the M3PD dataset, the first publicly available dual-view mobile photoplethysmography dataset, comprising synchronized facial and fingertip videos captured simultaneously via front and rear smartphone cameras from 60 participants (including 47 cardiovascular patients). Building on this dual-view setting, we further propose F3Mamba, which fuses the facial and fingertip views through Mamba-based temporal modeling. The model reduces heart-rate error by 21.9 to 30.2 percent over existing single-view baselines while improving robustness in challenging real-world scenarios. Data and code: https://github.com/Health-HCI-Group/F3Mamba.
title M3PD Dataset: Dual-view Photoplethysmography (PPG) Using Front-and-rear Cameras of Smartphones in Lab and Clinical Settings
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.02349