Summit Vitals: Multi-Camera and Multi-Signal Biosensing at High Altitudes

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Ke, Tang, Jiankai, Jiang, Zhang, Wang, Yuntao, Liu, Xiaojing, Li, Dong, Shi, Yuanchun
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929519743467520
author Liu, Ke
Tang, Jiankai
Jiang, Zhang
Wang, Yuntao
Liu, Xiaojing
Li, Dong
Shi, Yuanchun
author_facet Liu, Ke
Tang, Jiankai
Jiang, Zhang
Wang, Yuntao
Liu, Xiaojing
Li, Dong
Shi, Yuanchun
contents Video photoplethysmography (vPPG) is an emerging method for non-invasive and convenient measurement of physiological signals, utilizing two primary approaches: remote video PPG (rPPG) and contact video PPG (cPPG). Monitoring vitals in high-altitude environments, where heart rates tend to increase and blood oxygen levels often decrease, presents significant challenges. To address these issues, we introduce the SUMS dataset comprising 80 synchronized non-contact facial and contact finger videos from 10 subjects during exercise and oxygen recovery scenarios, capturing PPG, respiration rate (RR), and SpO2. This dataset is designed to validate video vitals estimation algorithms and compare facial rPPG with finger cPPG. Additionally, fusing videos from different positions (i.e., face and finger) reduces the mean absolute error (MAE) of SpO2 predictions by 7.6\% and 10.6\% compared to only face and only finger, respectively. In cross-subject evaluation, we achieve an MAE of less than 0.5 BPM for HR estimation and 2.5\% for SpO2 estimation, demonstrating the precision of our multi-camera fusion techniques. Our findings suggest that simultaneous training on multiple indicators, such as PPG and blood oxygen, can reduce MAE in SpO2 estimation by 17.8\%.
format Preprint
id arxiv_https___arxiv_org_abs_2409_19223
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Summit Vitals: Multi-Camera and Multi-Signal Biosensing at High Altitudes
Liu, Ke
Tang, Jiankai
Jiang, Zhang
Wang, Yuntao
Liu, Xiaojing
Li, Dong
Shi, Yuanchun
Computer Vision and Pattern Recognition
Signal Processing
Video photoplethysmography (vPPG) is an emerging method for non-invasive and convenient measurement of physiological signals, utilizing two primary approaches: remote video PPG (rPPG) and contact video PPG (cPPG). Monitoring vitals in high-altitude environments, where heart rates tend to increase and blood oxygen levels often decrease, presents significant challenges. To address these issues, we introduce the SUMS dataset comprising 80 synchronized non-contact facial and contact finger videos from 10 subjects during exercise and oxygen recovery scenarios, capturing PPG, respiration rate (RR), and SpO2. This dataset is designed to validate video vitals estimation algorithms and compare facial rPPG with finger cPPG. Additionally, fusing videos from different positions (i.e., face and finger) reduces the mean absolute error (MAE) of SpO2 predictions by 7.6\% and 10.6\% compared to only face and only finger, respectively. In cross-subject evaluation, we achieve an MAE of less than 0.5 BPM for HR estimation and 2.5\% for SpO2 estimation, demonstrating the precision of our multi-camera fusion techniques. Our findings suggest that simultaneous training on multiple indicators, such as PPG and blood oxygen, can reduce MAE in SpO2 estimation by 17.8\%.
title Summit Vitals: Multi-Camera and Multi-Signal Biosensing at High Altitudes
topic Computer Vision and Pattern Recognition
Signal Processing
url https://arxiv.org/abs/2409.19223