Perspective-Aware AI in Extended Reality

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Platnick, Daniel, Gruener, Matti, Alirezaie, Marjan, Larson, Kent, Newman, Dava J., Rahnama, Hossein
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866908450773008384
author Platnick, Daniel
Gruener, Matti
Alirezaie, Marjan
Larson, Kent
Newman, Dava J.
Rahnama, Hossein
author_facet Platnick, Daniel
Gruener, Matti
Alirezaie, Marjan
Larson, Kent
Newman, Dava J.
Rahnama, Hossein
contents AI-enhanced Extended Reality (XR) aims to deliver adaptive, immersive experiences-yet current systems fall short due to shallow user modeling and limited cognitive context. We introduce Perspective-Aware AI in Extended Reality (PAiR), a foundational framework for integrating Perspective-Aware AI (PAi) with XR to enable interpretable, context-aware experiences grounded in user identity. PAi is built on Chronicles: reasoning-ready identity models learned from multimodal digital footprints that capture users' cognitive and experiential evolution. PAiR employs these models in a closed-loop system linking dynamic user states with immersive environments. We present PAiR's architecture, detailing its modules and system flow, and demonstrate its utility through two proof-of-concept scenarios implemented in the Unity-based OpenDome engine. PAiR opens a new direction for human-AI interaction by embedding perspective-based identity models into immersive systems.
format Preprint
id arxiv_https___arxiv_org_abs_2507_11479
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Perspective-Aware AI in Extended Reality
Platnick, Daniel
Gruener, Matti
Alirezaie, Marjan
Larson, Kent
Newman, Dava J.
Rahnama, Hossein
Artificial Intelligence
Graphics
Human-Computer Interaction
AI-enhanced Extended Reality (XR) aims to deliver adaptive, immersive experiences-yet current systems fall short due to shallow user modeling and limited cognitive context. We introduce Perspective-Aware AI in Extended Reality (PAiR), a foundational framework for integrating Perspective-Aware AI (PAi) with XR to enable interpretable, context-aware experiences grounded in user identity. PAi is built on Chronicles: reasoning-ready identity models learned from multimodal digital footprints that capture users' cognitive and experiential evolution. PAiR employs these models in a closed-loop system linking dynamic user states with immersive environments. We present PAiR's architecture, detailing its modules and system flow, and demonstrate its utility through two proof-of-concept scenarios implemented in the Unity-based OpenDome engine. PAiR opens a new direction for human-AI interaction by embedding perspective-based identity models into immersive systems.
title Perspective-Aware AI in Extended Reality
topic Artificial Intelligence
Graphics
Human-Computer Interaction
url https://arxiv.org/abs/2507.11479