Cover Image

An Interaction Design Toolkit for Physical Task Guidance with Artificial Intelligence and Mixed Reality

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Caetano, Arthur, Aponte, Alejandro, Sra, Misha
Format:	Preprint
Published:	2024
Subjects:	Human-Computer Interaction H.5
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

GraspR: A Computational Model of Spatial User Preferences for Adaptive Grasp UI Design
by: Caetano, Arthur, et al.
Published: (2025)

Agentic Workflows for Conversational Human-AI Interaction Design
by: Caetano, Arthur, et al.
Published: (2025)

EntangleVR++: Evaluating the Potential of using Entanglement in an Interactive VR Scene Creation System
by: Chen, Mengyu, et al.
Published: (2024)

ConnectVR: A Trigger-Action Interface for Creating Agent-based Interactive VR Stories
by: Chen, Mengyu, et al.
Published: (2024)

ARfy: A Pipeline for Adapting 3D Scenes to Augmented Reality
by: Caetano, Arthur, et al.
Published: (2024)

XARP Tools: An Extended Reality Platform for Humans and AI Agents
by: Caetano, Arthur, et al.
Published: (2025)

GraV: Grasp Volume Data for the Design of One-Handed XR Interfaces
by: Aponte, Alejandro, et al.
Published: (2024)

Virtual Steps: The Experience of Walking for a Lifelong Wheelchair User in Virtual Reality
by: Taheri, Atieh, et al.
Published: (2024)

ARLang: An Outdoor Augmented Reality Application for Portuguese Vocabulary Learning
by: Caetano, Arthur, et al.
Published: (2024)

Shape-Kit: A Design Toolkit for Crafting On-Body Expressive Haptics
by: Zhou, Ran, et al.
Published: (2025)

Improving Interface Design in Interactive Task Learning for Hierarchical Tasks based on a Qualitative Study
by: Zhou, Jieyu, et al.
Published: (2024)

PlantoGraphy: Incorporating Iterative Design Process into Generative Artificial Intelligence for Landscape Rendering
by: Huang, Rong, et al.
Published: (2024)

Virtual Buddy: Redefining Conversational AI Interactions for Individuals with Hand Motor Disabilities
by: Taheri, Atieh, et al.
Published: (2024)

Audience Amplified: Virtual Audiences in Asynchronously Performed AR Theater
by: Kim, You-Jin, et al.
Published: (2025)

How Users Perceive Mixed-Initiative AI: Attitudes Toward Assistance in Problem Solving
by: Luo, Yunhao, et al.
Published: (2026)

SiCo: An Interactive Size-Controllable Virtual Try-On Approach for Informed Decision-Making
by: Chen, Sherry X., et al.
Published: (2024)

TaskLens: Generating Task-Conditioned Scaffolded Interfaces for Learning Professional Creative Software
by: Liu, Yimeng, et al.
Published: (2025)

UI Placement as a Critical Design Factor for Augmented Reality During Locomotion
by: Manakhov, Pavel, et al.
Published: (2026)

Responsible Trauma Research: Designing Effective and Sustainable Virtual Reality Exposure Studies
by: Degenhard, Annalisa, et al.
Published: (2026)

Cam-2-Cam: Exploring the Design Space of Dual-Camera Interactions for Smartphone-based Augmented Reality
by: Woodard, Brandon, et al.
Published: (2025)

Beyond Reality: Designing Personal Experiences and Interactive Narratives in AR Theater
by: Kim, You-Jin
Published: (2025)

Scaffolding Metacognition with GenAI: Exploring Design Opportunities to Support Task Management for University Students with ADHD
by: Zhu, Zihao, et al.
Published: (2026)

Seamless and Efficient Interactions within a Mixed-Dimensional Information Space
by: Chen, Chen
Published: (2025)

The People's Gaze: Co-Designing and Refining Gaze Gestures with General Users and Gaze Interaction Experts
by: Lei, Yaxiong, et al.
Published: (2026)

Detecting The Corruption Of Online Questionnaires By Artificial Intelligence
by: Lebrun, Benjamin, et al.
Published: (2023)

Facilitating Mixed-Methods Analysis with Computational Notebooks
by: Zhu, Jiawen Stefanie, et al.
Published: (2024)

Measuring Love Toward AI: Development and Validation of the Love Attitudes Scale toward Artificial Intelligence (LAS-AI)
by: Li, Runze, et al.
Published: (2026)

Developing an AI Concept Envisioning Toolkit to Support Reflective Juxtaposition of Values and Harms
by: Sinlapanuntakul, Pitch, et al.
Published: (2026)

Leveraging Virtual Reality Simulation to Engage Non-Disabled People in Reflection on Access Barriers for Disabled People
by: Brogle, Timo, et al.
Published: (2024)

VisiMark: Characterizing and Augmenting Landmarks for People with Low Vision in Augmented Reality to Support Indoor Navigation
by: Chen, Ruijia, et al.
Published: (2025)

Interaction Design with Generative AI: An Empirical Study of Emerging Strategies Across the Four Phases of Design
by: Muehlhaus, Marie, et al.
Published: (2024)

Is it Me? Toward Self-Extension to AI Avatars in Virtual Reality
by: Zhang, Jieying, et al.
Published: (2026)

Designing Scaffolded Interfaces for Enhanced Learning and Performance in Professional Software
by: Liu, Yimeng, et al.
Published: (2025)

Fast-Forward Reality: Authoring Error-Free Context-Aware Policies with Real-Time Unit Tests in Extended Reality
by: Qian, Xun, et al.
Published: (2024)

MineXR: Mining Personalized Extended Reality Interfaces
by: Cho, Hyunsung, et al.
Published: (2024)

Demystifying Reward Design in Reinforcement Learning for Upper Extremity Interaction: Practical Guidelines for Biomechanical Simulations in HCI
by: Selder, Hannah, et al.
Published: (2025)

Analysing Human Interaction with Electronic Displays in Microgravity
by: Biswas, Pradipta, et al.
Published: (2026)

pARam: Leveraging Parametric Design in Extended Reality to Support the Personalization of Artifacts for Personal Fabrication
by: Stemasov, Evgeny, et al.
Published: (2024)

Cultural Newcomers Dining Across Borders: Need-Based Design Envision of Mixed Media Integration in MR for Foreign Menu Understanding and Ordering
by: Zhang, Ying, et al.
Published: (2026)

Effects of Human Avatar Representation in Virtual Reality on Inter-Brain Connection
by: Yigitbas, Enes, et al.
Published: (2024)