Hybrid User Interfaces: Past, Present, and Future of Complementary Cross-Device Interaction in Mixed Reality
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914232200593408 |
|---|---|
| author | Hubenschmid, Sebastian Satkowski, Marc Zagermann, Johannes Méndez, Julián Elmqvist, Niklas Feiner, Steven Feuchtner, Tiare Grønbæk, Jens Emil Lee, Benjamin Schmalstieg, Dieter Dachselt, Raimund Reiterer, Harald |
| author_facet | Hubenschmid, Sebastian Satkowski, Marc Zagermann, Johannes Méndez, Julián Elmqvist, Niklas Feiner, Steven Feuchtner, Tiare Grønbæk, Jens Emil Lee, Benjamin Schmalstieg, Dieter Dachselt, Raimund Reiterer, Harald |
| contents | We investigate hybrid user interfaces (HUIs), aiming to establish a cohesive understanding and adopt consistent terminology for this nascent research area. HUIs combine heterogeneous devices in complementary roles, leveraging the distinct benefits of each. Our work focuses on cross-device interaction between 2D devices and mixed reality environments, which are particularly compelling, leveraging the familiarity of traditional 2D platforms while providing spatial awareness and immersion. Although such HUIs have been prominently explored in the context of mixed reality by prior work, we still lack a cohesive understanding of the unique design possibilities and challenges of such combinations, resulting in a fragmented research landscape. We conducted a systematic survey and present a taxonomy of HUIs that combine conventional display technology and mixed reality environments. Based on this, we discuss past and current challenges, the evolution of definitions, and prospective opportunities to tie together the past 30 years of research with our vision of future HUIs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_05491 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Hybrid User Interfaces: Past, Present, and Future of Complementary Cross-Device Interaction in Mixed Reality Hubenschmid, Sebastian Satkowski, Marc Zagermann, Johannes Méndez, Julián Elmqvist, Niklas Feiner, Steven Feuchtner, Tiare Grønbæk, Jens Emil Lee, Benjamin Schmalstieg, Dieter Dachselt, Raimund Reiterer, Harald Human-Computer Interaction We investigate hybrid user interfaces (HUIs), aiming to establish a cohesive understanding and adopt consistent terminology for this nascent research area. HUIs combine heterogeneous devices in complementary roles, leveraging the distinct benefits of each. Our work focuses on cross-device interaction between 2D devices and mixed reality environments, which are particularly compelling, leveraging the familiarity of traditional 2D platforms while providing spatial awareness and immersion. Although such HUIs have been prominently explored in the context of mixed reality by prior work, we still lack a cohesive understanding of the unique design possibilities and challenges of such combinations, resulting in a fragmented research landscape. We conducted a systematic survey and present a taxonomy of HUIs that combine conventional display technology and mixed reality environments. Based on this, we discuss past and current challenges, the evolution of definitions, and prospective opportunities to tie together the past 30 years of research with our vision of future HUIs. |
| title | Hybrid User Interfaces: Past, Present, and Future of Complementary Cross-Device Interaction in Mixed Reality |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2509.05491 |