Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2509.07990 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912579414130688 |
|---|---|
| author | Chenchu, Charan Gajjala Kim, Kinam Lu, Gao Din, Zia Ud |
| author_facet | Chenchu, Charan Gajjala Kim, Kinam Lu, Gao Din, Zia Ud |
| contents | Human-robot collaboration (HRC) in the construction industry depends on precise and prompt recognition of human motion intentions and actions by robots to maximize safety and workflow efficiency. There is a research gap in comparing data modalities, specifically signals and videos, for motion intention recognition. To address this, the study leverages deep learning to assess two different modalities in recognizing workers' motion intention at the early stage of movement in drywall installation tasks. The Convolutional Neural Network - Long Short-Term Memory (CNN-LSTM) model utilizing surface electromyography (sEMG) data achieved an accuracy of around 87% with an average time of 0.04 seconds to perform prediction on a sample input. Meanwhile, the pre-trained Video Swin Transformer combined with transfer learning harnessed video sequences as input to recognize motion intention and attained an accuracy of 94% but with a longer average time of 0.15 seconds for a similar prediction. This study emphasizes the unique strengths and trade-offs of both data formats, directing their systematic deployments to enhance HRC in real-world construction projects. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_07990 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Signals vs. Videos: Advancing Motion Intention Recognition for Human-Robot Collaboration in Construction Chenchu, Charan Gajjala Kim, Kinam Lu, Gao Din, Zia Ud Signal Processing Artificial Intelligence Machine Learning Human-robot collaboration (HRC) in the construction industry depends on precise and prompt recognition of human motion intentions and actions by robots to maximize safety and workflow efficiency. There is a research gap in comparing data modalities, specifically signals and videos, for motion intention recognition. To address this, the study leverages deep learning to assess two different modalities in recognizing workers' motion intention at the early stage of movement in drywall installation tasks. The Convolutional Neural Network - Long Short-Term Memory (CNN-LSTM) model utilizing surface electromyography (sEMG) data achieved an accuracy of around 87% with an average time of 0.04 seconds to perform prediction on a sample input. Meanwhile, the pre-trained Video Swin Transformer combined with transfer learning harnessed video sequences as input to recognize motion intention and attained an accuracy of 94% but with a longer average time of 0.15 seconds for a similar prediction. This study emphasizes the unique strengths and trade-offs of both data formats, directing their systematic deployments to enhance HRC in real-world construction projects. |
| title | Signals vs. Videos: Advancing Motion Intention Recognition for Human-Robot Collaboration in Construction |
| topic | Signal Processing Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2509.07990 |