milliFlow: Scene Flow Estimation on mmWave Radar Point Cloud for Human Motion Sensing
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916324907679744 |
|---|---|
| author | Ding, Fangqiang Luo, Zhen Zhao, Peijun Lu, Chris Xiaoxuan |
| author_facet | Ding, Fangqiang Luo, Zhen Zhao, Peijun Lu, Chris Xiaoxuan |
| contents | Human motion sensing plays a crucial role in smart systems for decision-making, user interaction, and personalized services. Extensive research that has been conducted is predominantly based on cameras, whose intrusive nature limits their use in smart home applications. To address this, mmWave radars have gained popularity due to their privacy-friendly features. In this work, we propose milliFlow, a novel deep learning approach to estimate scene flow as complementary motion information for mmWave point cloud, serving as an intermediate level of features and directly benefiting downstream human motion sensing tasks. Experimental results demonstrate the superior performance of our method when compared with the competing approaches. Furthermore, by incorporating scene flow information, we achieve remarkable improvements in human activity recognition and human parsing and support human body part tracking. Code and dataset are available at https://github.com/Toytiny/milliFlow. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2306_17010 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | milliFlow: Scene Flow Estimation on mmWave Radar Point Cloud for Human Motion Sensing Ding, Fangqiang Luo, Zhen Zhao, Peijun Lu, Chris Xiaoxuan Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning Human motion sensing plays a crucial role in smart systems for decision-making, user interaction, and personalized services. Extensive research that has been conducted is predominantly based on cameras, whose intrusive nature limits their use in smart home applications. To address this, mmWave radars have gained popularity due to their privacy-friendly features. In this work, we propose milliFlow, a novel deep learning approach to estimate scene flow as complementary motion information for mmWave point cloud, serving as an intermediate level of features and directly benefiting downstream human motion sensing tasks. Experimental results demonstrate the superior performance of our method when compared with the competing approaches. Furthermore, by incorporating scene flow information, we achieve remarkable improvements in human activity recognition and human parsing and support human body part tracking. Code and dataset are available at https://github.com/Toytiny/milliFlow. |
| title | milliFlow: Scene Flow Estimation on mmWave Radar Point Cloud for Human Motion Sensing |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2306.17010 |