Semantic Reality: Interactive Context-Aware Visualization of Inter-Object Relationships in Augmented Reality
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917387713904640 |
|---|---|
| author | Liu, Xiaoan Gonzalez, Eric J Numan, Nels Colaço, Andrea Abramyan, Lucy Zhu-Tian, Chen Suzuki, Ryo Gonzalez-Franco, Mar |
| author_facet | Liu, Xiaoan Gonzalez, Eric J Numan, Nels Colaço, Andrea Abramyan, Lucy Zhu-Tian, Chen Suzuki, Ryo Gonzalez-Franco, Mar |
| contents | Bridging the physical and digital world through interaction remains a core challenge in augmented reality (AR). Existing systems target single objects, limiting support for planning, comparison, and assembly tasks that depend on relationships among multiple items. We present Semantic Reality, an AR system focused on surfacing inter-object connectivity and making it interactive. Leveraging multimodal reasoning, spatial anchoring, and physical action recognition, Semantic Reality maintains a persistent model of objects around the user and their relationships. Connections are visualized in-situ to highlight compatibility, reveal next steps, and reduce ambiguity during tasks. We contribute a connectivity-centered interaction paradigm and a system architecture that couples anchor tracking, action sensing, and model inference to construct a live connectivity graph. In an exploratory study comparing Semantic Reality to a single-object baseline, participants reported clearer inter-object understanding and higher engagement and satisfaction, without increased workload. A scenario study illustrates where connectivity aids planning, sequencing, and disambiguation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_05265 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Semantic Reality: Interactive Context-Aware Visualization of Inter-Object Relationships in Augmented Reality Liu, Xiaoan Gonzalez, Eric J Numan, Nels Colaço, Andrea Abramyan, Lucy Zhu-Tian, Chen Suzuki, Ryo Gonzalez-Franco, Mar Human-Computer Interaction H.5.2; H.2.11; I.2.10 Bridging the physical and digital world through interaction remains a core challenge in augmented reality (AR). Existing systems target single objects, limiting support for planning, comparison, and assembly tasks that depend on relationships among multiple items. We present Semantic Reality, an AR system focused on surfacing inter-object connectivity and making it interactive. Leveraging multimodal reasoning, spatial anchoring, and physical action recognition, Semantic Reality maintains a persistent model of objects around the user and their relationships. Connections are visualized in-situ to highlight compatibility, reveal next steps, and reduce ambiguity during tasks. We contribute a connectivity-centered interaction paradigm and a system architecture that couples anchor tracking, action sensing, and model inference to construct a live connectivity graph. In an exploratory study comparing Semantic Reality to a single-object baseline, participants reported clearer inter-object understanding and higher engagement and satisfaction, without increased workload. A scenario study illustrates where connectivity aids planning, sequencing, and disambiguation. |
| title | Semantic Reality: Interactive Context-Aware Visualization of Inter-Object Relationships in Augmented Reality |
| topic | Human-Computer Interaction H.5.2; H.2.11; I.2.10 |
| url | https://arxiv.org/abs/2604.05265 |