MHAD: Multimodal Home Activity Dataset with Multi-Angle Videos and Synchronized Physiological Signals

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Yu, Lei, Fei, Jintao, Liu, Xinyi, Yao, Yang, Zhao, Jun, Wang, Guoxin, Li, Xin
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917998170734592
author Yu, Lei
Fei, Jintao
Liu, Xinyi
Yao, Yang
Zhao, Jun
Wang, Guoxin
Li, Xin
author_facet Yu, Lei
Fei, Jintao
Liu, Xinyi
Yao, Yang
Zhao, Jun
Wang, Guoxin
Li, Xin
contents Video-based physiology, exemplified by remote photoplethysmography (rPPG), extracts physiological signals such as pulse and respiration by analyzing subtle changes in video recordings. This non-contact, real-time monitoring method holds great potential for home settings. Despite the valuable contributions of public benchmark datasets to this technology, there is currently no dataset specifically designed for passive home monitoring. Existing datasets are often limited to close-up, static, frontal recordings and typically include only 1-2 physiological signals. To advance video-based physiology in real home settings, we introduce the MHAD dataset. It comprises 1,440 videos from 40 subjects, capturing 6 typical activities from 3 angles in a real home environment. Additionally, 5 physiological signals were recorded, making it a comprehensive video-based physiology dataset. MHAD is compatible with the rPPG-toolbox and has been validated using several unsupervised and supervised methods. Our dataset is publicly available at https://github.com/jdh-algo/MHAD-Dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2409_09366
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle MHAD: Multimodal Home Activity Dataset with Multi-Angle Videos and Synchronized Physiological Signals
Yu, Lei
Fei, Jintao
Liu, Xinyi
Yao, Yang
Zhao, Jun
Wang, Guoxin
Li, Xin
Computer Vision and Pattern Recognition
Multimedia
Video-based physiology, exemplified by remote photoplethysmography (rPPG), extracts physiological signals such as pulse and respiration by analyzing subtle changes in video recordings. This non-contact, real-time monitoring method holds great potential for home settings. Despite the valuable contributions of public benchmark datasets to this technology, there is currently no dataset specifically designed for passive home monitoring. Existing datasets are often limited to close-up, static, frontal recordings and typically include only 1-2 physiological signals. To advance video-based physiology in real home settings, we introduce the MHAD dataset. It comprises 1,440 videos from 40 subjects, capturing 6 typical activities from 3 angles in a real home environment. Additionally, 5 physiological signals were recorded, making it a comprehensive video-based physiology dataset. MHAD is compatible with the rPPG-toolbox and has been validated using several unsupervised and supervised methods. Our dataset is publicly available at https://github.com/jdh-algo/MHAD-Dataset.
title MHAD: Multimodal Home Activity Dataset with Multi-Angle Videos and Synchronized Physiological Signals
topic Computer Vision and Pattern Recognition
Multimedia
url https://arxiv.org/abs/2409.09366