Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2411.08641 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912117827829760 |
|---|---|
| author | Wang, Xinkai Zhang, Shuo Zhao, Ziyi Zhu, Lifeng Song, Aiguo |
| author_facet | Wang, Xinkai Zhang, Shuo Zhao, Ziyi Zhu, Lifeng Song, Aiguo |
| contents | While tangible user interface has shown its power in naturally interacting with rigid or soft objects, users cannot conveniently use different types of granular materials as the interaction media. We introduce DipMe as a smart device to recognize the types of granular media in real time, which can be used to connect the granular materials in the physical world with various virtual content. Other than vision-based solutions, we propose a dip operation of our device and exploit the haptic signals to recognize different types of granular materials. With modern machine learning tools, we find the haptic signals from different granular media are distinguishable by DipMe. With the online granular object recognition, we build several tangible interactive applications, demonstrating the effects of DipMe in perceiving granular materials and its potential in developing a tangible user interface with granular objects as the new media. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_08641 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | DipMe: Haptic Recognition of Granular Media for Tangible Interactive Applications Wang, Xinkai Zhang, Shuo Zhao, Ziyi Zhu, Lifeng Song, Aiguo Human-Computer Interaction Artificial Intelligence While tangible user interface has shown its power in naturally interacting with rigid or soft objects, users cannot conveniently use different types of granular materials as the interaction media. We introduce DipMe as a smart device to recognize the types of granular media in real time, which can be used to connect the granular materials in the physical world with various virtual content. Other than vision-based solutions, we propose a dip operation of our device and exploit the haptic signals to recognize different types of granular materials. With modern machine learning tools, we find the haptic signals from different granular media are distinguishable by DipMe. With the online granular object recognition, we build several tangible interactive applications, demonstrating the effects of DipMe in perceiving granular materials and its potential in developing a tangible user interface with granular objects as the new media. |
| title | DipMe: Haptic Recognition of Granular Media for Tangible Interactive Applications |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2411.08641 |