A Plug-and-Play Temporal Normalization Module for Robust Remote Photoplethysmography
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912130994798592 |
|---|---|
| author | Wang, Kegang Tang, Jiankai Wei, Yantao Liu, Mingxuan Liu, Xin Wang, Yuntao |
| author_facet | Wang, Kegang Tang, Jiankai Wei, Yantao Liu, Mingxuan Liu, Xin Wang, Yuntao |
| contents | Remote photoplethysmography (rPPG) extracts PPG signals from subtle color changes in facial videos, showing strong potential for health applications. However, most rPPG methods rely on intensity differences between consecutive frames, missing long-term signal variations affected by motion or lighting artifacts, which reduces accuracy. This paper introduces Temporal Normalization (TN), a flexible plug-and-play module compatible with any end-to-end rPPG network architecture. By capturing long-term temporally normalized features following detrending, TN effectively mitigates motion and lighting artifacts, significantly boosting the rPPG prediction performance. When integrated into four state-of-the-art rPPG methods, TN delivered performance improvements ranging from 34.3% to 94.2% in heart rate measurement tasks across four widely-used datasets. Notably, TN showed even greater performance gains in smaller models. We further discuss and provide insights into the mechanisms behind TN's effectiveness. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_15283 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Plug-and-Play Temporal Normalization Module for Robust Remote Photoplethysmography Wang, Kegang Tang, Jiankai Wei, Yantao Liu, Mingxuan Liu, Xin Wang, Yuntao Image and Video Processing Computer Vision and Pattern Recognition 68T10 I.2.10 Remote photoplethysmography (rPPG) extracts PPG signals from subtle color changes in facial videos, showing strong potential for health applications. However, most rPPG methods rely on intensity differences between consecutive frames, missing long-term signal variations affected by motion or lighting artifacts, which reduces accuracy. This paper introduces Temporal Normalization (TN), a flexible plug-and-play module compatible with any end-to-end rPPG network architecture. By capturing long-term temporally normalized features following detrending, TN effectively mitigates motion and lighting artifacts, significantly boosting the rPPG prediction performance. When integrated into four state-of-the-art rPPG methods, TN delivered performance improvements ranging from 34.3% to 94.2% in heart rate measurement tasks across four widely-used datasets. Notably, TN showed even greater performance gains in smaller models. We further discuss and provide insights into the mechanisms behind TN's effectiveness. |
| title | A Plug-and-Play Temporal Normalization Module for Robust Remote Photoplethysmography |
| topic | Image and Video Processing Computer Vision and Pattern Recognition 68T10 I.2.10 |
| url | https://arxiv.org/abs/2411.15283 |