Prop-Chromeleon: Adaptive Haptic Props in Mixed Reality through Generative Artificial Intelligence
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910189123272704 |
|---|---|
| author | Wang, Haoyu Zhu, Fengyuan Huang, Bingjian Wang, Zhecheng Sidenmark, Ludwig |
| author_facet | Wang, Haoyu Zhu, Fengyuan Huang, Bingjian Wang, Zhecheng Sidenmark, Ludwig |
| contents | Mixed Reality (MR) aims to blend digital and physical worlds, but the absence of haptic feedback often breaks visual-tactile consistency. We introduce Prop-Chromeleon, a MR system based on generative artificial intelligence (AI) that dynamically transforms everyday objects into adaptive passive haptic props through user-provided text prompts. Our AI pipeline performs generation and anchoring of virtual assets that align with the shape of physical props, allowing us to study how virtual content generation behaves under geometric and prompt-based constraints. We evaluate Prop-Chromeleon's effectiveness through a generation study using varied object shapes and user prompts, combining quantitative shape similarity metrics with qualitative prompt fidelity analysis. Our user study further showcases Prop-Chromeleon's improvements in perceived realism, immersion, and enjoyment compared to static baselines. These results show that shape-aware generation can support both believable haptic interaction and creative engagement in MR. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_00804 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Prop-Chromeleon: Adaptive Haptic Props in Mixed Reality through Generative Artificial Intelligence Wang, Haoyu Zhu, Fengyuan Huang, Bingjian Wang, Zhecheng Sidenmark, Ludwig Human-Computer Interaction Mixed Reality (MR) aims to blend digital and physical worlds, but the absence of haptic feedback often breaks visual-tactile consistency. We introduce Prop-Chromeleon, a MR system based on generative artificial intelligence (AI) that dynamically transforms everyday objects into adaptive passive haptic props through user-provided text prompts. Our AI pipeline performs generation and anchoring of virtual assets that align with the shape of physical props, allowing us to study how virtual content generation behaves under geometric and prompt-based constraints. We evaluate Prop-Chromeleon's effectiveness through a generation study using varied object shapes and user prompts, combining quantitative shape similarity metrics with qualitative prompt fidelity analysis. Our user study further showcases Prop-Chromeleon's improvements in perceived realism, immersion, and enjoyment compared to static baselines. These results show that shape-aware generation can support both believable haptic interaction and creative engagement in MR. |
| title | Prop-Chromeleon: Adaptive Haptic Props in Mixed Reality through Generative Artificial Intelligence |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2605.00804 |