Towards Open-World Gesture Recognition
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914964978008064 |
|---|---|
| author | Shen, Junxiao De Lange, Matthias Xu, Xuhai "Orson" Zhou, Enmin Tan, Ran Suda, Naveen Lazarewicz, Maciej Kristensson, Per Ola Karlson, Amy Strasnick, Evan |
| author_facet | Shen, Junxiao De Lange, Matthias Xu, Xuhai "Orson" Zhou, Enmin Tan, Ran Suda, Naveen Lazarewicz, Maciej Kristensson, Per Ola Karlson, Amy Strasnick, Evan |
| contents | Providing users with accurate gestural interfaces, such as gesture recognition based on wrist-worn devices, is a key challenge in mixed reality. However, static machine learning processes in gesture recognition assume that training and test data come from the same underlying distribution. Unfortunately, in real-world applications involving gesture recognition, such as gesture recognition based on wrist-worn devices, the data distribution may change over time. We formulate this problem of adapting recognition models to new tasks, where new data patterns emerge, as open-world gesture recognition (OWGR). We propose the use of continual learning to enable machine learning models to be adaptive to new tasks without degrading performance on previously learned tasks. However, the process of exploring parameters for questions around when, and how, to train and deploy recognition models requires resource-intensive user studies may be impractical. To address this challenge, we propose a design engineering approach that enables offline analysis on a collected large-scale dataset by systematically examining various parameters and comparing different continual learning methods. Finally, we provide design guidelines to enhance the development of an open-world wrist-worn gesture recognition process. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_11144 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Towards Open-World Gesture Recognition Shen, Junxiao De Lange, Matthias Xu, Xuhai "Orson" Zhou, Enmin Tan, Ran Suda, Naveen Lazarewicz, Maciej Kristensson, Per Ola Karlson, Amy Strasnick, Evan Computer Vision and Pattern Recognition Providing users with accurate gestural interfaces, such as gesture recognition based on wrist-worn devices, is a key challenge in mixed reality. However, static machine learning processes in gesture recognition assume that training and test data come from the same underlying distribution. Unfortunately, in real-world applications involving gesture recognition, such as gesture recognition based on wrist-worn devices, the data distribution may change over time. We formulate this problem of adapting recognition models to new tasks, where new data patterns emerge, as open-world gesture recognition (OWGR). We propose the use of continual learning to enable machine learning models to be adaptive to new tasks without degrading performance on previously learned tasks. However, the process of exploring parameters for questions around when, and how, to train and deploy recognition models requires resource-intensive user studies may be impractical. To address this challenge, we propose a design engineering approach that enables offline analysis on a collected large-scale dataset by systematically examining various parameters and comparing different continual learning methods. Finally, we provide design guidelines to enhance the development of an open-world wrist-worn gesture recognition process. |
| title | Towards Open-World Gesture Recognition |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2401.11144 |