FlashCap: Millisecond-Accurate Human Motion Capture via Flashing LEDs and Event-Based Vision
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2026
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912975897493504 |
|---|---|
| author | Wu, Zekai Fan, Shuqi Liu, Mengyin Luo, Yuhua Lin, Xincheng Yan, Ming Wu, Junhao Lin, Xiuhong Ma, Yuexin Wen, Chenglu Xu, Lan Shen, Siqi Wang, Cheng |
| author_facet | Wu, Zekai Fan, Shuqi Liu, Mengyin Luo, Yuhua Lin, Xincheng Yan, Ming Wu, Junhao Lin, Xiuhong Ma, Yuexin Wen, Chenglu Xu, Lan Shen, Siqi Wang, Cheng |
| contents | Precise motion timing (PMT) is crucial for swift motion analysis. A millisecond difference may determine victory or defeat in sports competitions. Despite substantial progress in human pose estimation (HPE), PMT remains largely overlooked by the HPE community due to the limited availability of high-temporal-resolution labeled datasets. Today, PMT is achieved using high-speed RGB cameras in specialized scenarios such as the Olympic Games; however, their high costs, light sensitivity, bandwidth, and computational complexity limit their feasibility for daily use. We developed FlashCap, the first flashing LED-based MoCap system for PMT. With FlashCap, we collect a millisecond-resolution human motion dataset, FlashMotion, comprising the event, RGB, LiDAR, and IMU modalities, and demonstrate its high quality through rigorous validation. To evaluate the merits of FlashMotion, we perform two tasks: precise motion timing and high-temporal-resolution HPE. For these tasks, we propose ResPose, a simple yet effective baseline that learns residual poses based on events and RGBs. Experimental results show that ResPose reduces pose estimation errors by ~40% and achieves millisecond-level timing accuracy, enabling new research opportunities. The dataset and code will be shared with the community. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_19770 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | FlashCap: Millisecond-Accurate Human Motion Capture via Flashing LEDs and Event-Based Vision Wu, Zekai Fan, Shuqi Liu, Mengyin Luo, Yuhua Lin, Xincheng Yan, Ming Wu, Junhao Lin, Xiuhong Ma, Yuexin Wen, Chenglu Xu, Lan Shen, Siqi Wang, Cheng Computer Vision and Pattern Recognition Precise motion timing (PMT) is crucial for swift motion analysis. A millisecond difference may determine victory or defeat in sports competitions. Despite substantial progress in human pose estimation (HPE), PMT remains largely overlooked by the HPE community due to the limited availability of high-temporal-resolution labeled datasets. Today, PMT is achieved using high-speed RGB cameras in specialized scenarios such as the Olympic Games; however, their high costs, light sensitivity, bandwidth, and computational complexity limit their feasibility for daily use. We developed FlashCap, the first flashing LED-based MoCap system for PMT. With FlashCap, we collect a millisecond-resolution human motion dataset, FlashMotion, comprising the event, RGB, LiDAR, and IMU modalities, and demonstrate its high quality through rigorous validation. To evaluate the merits of FlashMotion, we perform two tasks: precise motion timing and high-temporal-resolution HPE. For these tasks, we propose ResPose, a simple yet effective baseline that learns residual poses based on events and RGBs. Experimental results show that ResPose reduces pose estimation errors by ~40% and achieves millisecond-level timing accuracy, enabling new research opportunities. The dataset and code will be shared with the community. |
| title | FlashCap: Millisecond-Accurate Human Motion Capture via Flashing LEDs and Event-Based Vision |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2603.19770 |