Cover Image

Grounded GUI Understanding for Vision-Based Spatial Intelligent Agent: Exemplified by Extended Reality Apps

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Shuqing, Li, Binchang, Liu, Yepang, Gao, Cuiyun, Zhang, Jianping, Cheung, Shing-Chi, Lyu, Michael R.
Format:	Preprint
Published:	2024
Subjects:	Software Engineering Artificial Intelligence Computer Vision and Pattern Recognition Human-Computer Interaction Multimedia D.2.5; H.5.1; H.5.2; I.4.8
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Less Cybersickness, Please: Demystifying and Detecting Stereoscopic Visual Inconsistencies in Virtual Reality Apps
by: Li, Shuqing, et al.
Published: (2024)

Exploration of Embodied Space Experience through Umbilical Interaction: A Grounded Theory Approach
by: Guo, Shuai, et al.
Published: (2025)

Self++: Co-Determined Agency for Human--AI Symbiosis in Extended Reality
by: Piumsomboon, Thammathip
Published: (2026)

Spoken Humanoid Embodied Conversational Agents in Mobile Serious Games: A Usability Assessment
by: Korre, Danai, et al.
Published: (2023)

Listen to the Unexpected: Self-Supervised Surprise Detection for Efficient Viewport Prediction
by: Khah, Arman Nik, et al.
Published: (2026)

The Interaction Fidelity Model: A Taxonomy to Distinguish the Aspects of Fidelity in Virtual Reality
by: Bonfert, Michael, et al.
Published: (2024)

Auptimize: Optimal Placement of Spatial Audio Cues for Extended Reality
by: Cho, Hyunsung, et al.
Published: (2024)

SABER: Spatial Attention, Brain, Extended Reality
by: Bullock, Tom, et al.
Published: (2026)

MapStory: Prototyping Editable Map Animations with LLM Agents
by: Gunturu, Aditya, et al.
Published: (2025)

GestoBrush: Facilitating Graffiti Artists' Digital Creation Experiences through Embodied AR Interactions
by: Chen, Ruiqi, et al.
Published: (2025)

Geo2Sound: A Scalable Geo-Aligned Framework for Soundscape Generation from Satellite Imagery
by: Wu, Kunlin, et al.
Published: (2026)

A Framework for Multimodal Medical Image Interaction
by: Schütz, Laura, et al.
Published: (2024)

Evaluating Keyframe Layouts for Visual Known-Item Search in Homogeneous Collections
by: Jäckl, Bastian, et al.
Published: (2025)

Augmented Assembly: Object Recognition and Hand Tracking for Adaptive Assembly Instructions in Augmented Reality
by: Kyaw, Alexander Htet, et al.
Published: (2025)

What is "Spatial" about Spatial Computing?
by: Wang, Yibo, et al.
Published: (2025)

Music2P: A Multi-Modal AI-Driven Tool for Simplifying Album Cover Design
by: Choi, Joong Ho, et al.
Published: (2024)

Cam-2-Cam: Exploring the Design Space of Dual-Camera Interactions for Smartphone-based Augmented Reality
by: Woodard, Brandon, et al.
Published: (2025)

AudioMiXR: Spatial Audio Object Manipulation with 6DoF for Sound Design in Augmented Reality
by: Woodard, Brandon, et al.
Published: (2025)

GroundLink: Exploring How Contextual Meeting Snippets Can Close Common Ground Gaps in Editing 3D Scenes for Virtual Production
by: Woo, Gun, et al.
Published: (2026)

Reality Distortion Room: A Study of User Locomotion Responses to Spatial Augmented Reality Effects
by: Kim, You-Jin, et al.
Published: (2025)

SonoHaptics: An Audio-Haptic Cursor for Gaze-Based Object Selection in XR
by: Cho, Hyunsung, et al.
Published: (2024)

EXR: An Interactive Immersive EHR Visualization in Extended Reality
by: Marteau, Benoit, et al.
Published: (2025)

Augmented Object Intelligence with XR-Objects
by: Dogan, Mustafa Doga, et al.
Published: (2024)

AI Assisted AR Assembly: Object Recognition and Computer Vision for Augmented Reality Assisted Assembly
by: Kyaw, Alexander Htet, et al.
Published: (2025)

Gamification as a Data Acquisition Strategy for Neurogames
by: Saldivar, Diego
Published: (2025)

CompanionCast: Toward Social Collaboration with Multi-Agent Systems in Shared Experiences
by: Wang, Yiyang, et al.
Published: (2025)

If You Hold Me Without Hurting Me: Pathways to Designing Game Audio for Healthy Escapism and Player Well-being
by: Nunes, Caio, et al.
Published: (2025)

TinkerXR: In-Situ, Reality-Aware CAD and 3D Printing Interface for Novices
by: Arslan, Oğuz, et al.
Published: (2024)

INDS: Incremental Named Data Streaming for Real-Time Point Cloud Video
by: Chai, Ruonan, et al.
Published: (2025)

Towards Inclusive External Human-Machine Interface: Exploring the Effects of Visual and Auditory eHMI for Deaf and Hard-of-Hearing People
by: Xu, Wenge, et al.
Published: (2026)

Exploring the Impacts of Background Noise on Auditory Stimuli of Audio-Visual eHMIs for Hearing, Deaf, and Hard-of-Hearing People
by: Xu, Wenge, et al.
Published: (2026)

52-Hz Whale Song: An Embodied VR Experience for Exploring Misunderstanding and Empathy
by: Meng, Yibo, et al.
Published: (2026)

Misty Forest VR: Turning Real ADHD Attention Patterns into Shared Momentum for Youth Collaboration
by: Meng, Yibo, et al.
Published: (2026)

A Real-Time, Vision-Based System for Badminton Smash Speed Estimation on Mobile Devices
by: Huang, Diwen
Published: (2025)

Beyond Reality: Designing Personal Experiences and Interactive Narratives in AR Theater
by: Kim, You-Jin
Published: (2025)

FaceValue: Exploring Real-Time Self-View Overlays to Prompt Meaning-Oriented Self-Awareness in Remote Meetings
by: Park, Gun Woo Warren, et al.
Published: (2026)

Spatial Orchestra: Locomotion Music Instruments through Spatial Exploration
by: Kim, You-Jin, et al.
Published: (2025)

The Impact of Navigation Aids on Search Performance and Object Recall in Wide-Area Augmented Reality
by: Kumaran, Radha, et al.
Published: (2025)

FractalBrain: A Neuro-interactive Virtual Reality Experience using Electroencephalogram (EEG) for Mindfulness
by: Dinh, Jamie Ngoc, et al.
Published: (2025)

To Slide or Not to Slide: Exploring Techniques for Comparing Immersive Videos
by: Wang, Xizi, et al.
Published: (2026)