Cover Image

Analyzing Multimodal Interaction Strategies for LLM-Assisted Manipulation of 3D Scenes

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Junlong, Grubert, Jens, Kristensson, Per Ola
Format:	Preprint
Published:	2024
Subjects:	Human-Computer Interaction Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Large Language Model-assisted Speech and Pointing Benefits Multiple 3D Object Selection in Virtual Reality
by: Chen, Junlong, et al.
Published: (2024)

Generative AI for Accessible and Inclusive Extended Reality
by: Grubert, Jens, et al.
Published: (2024)

Prompt-Driven Agentic Video Editing System: Autonomous Comprehension of Long-Form, Story-Driven Media
by: Ding, Zihan, et al.
Published: (2025)

MyoInteract: A Framework for Fast Prototyping of Biomechanical HCI Tasks using Reinforcement Learning
by: Bhattarai, Ankit, et al.
Published: (2026)

ImageTalk: Designing a Multimodal AAC Text Generation System Driven by Image Recognition and Natural Language Generation
by: Yang, Boyin, et al.
Published: (2025)

Unbounded: Object-Boundary Interaction in Mixed Reality
by: Lyu, Zhuoyue, et al.
Published: (2025)

Encode-Store-Retrieve: Augmenting Human Memory through Language-Encoded Egocentric Perception
by: Shen, Junxiao, et al.
Published: (2023)

Objestures: Everyday Objects Meet Mid-Air Gestures for Expressive Interaction
by: Lyu, Zhuoyue, et al.
Published: (2025)

EnVisionVR: A Scene Interpretation Tool for Visual Accessibility in Virtual Reality
by: Chen, Junlong, et al.
Published: (2025)

ReachVox: Clutter-free Reachability Visualization for Robot Motion Planning in Virtual Reality
by: Hauck, Steffen, et al.
Published: (2025)

Accented Character Entry Using Physical Keyboards in Virtual Reality
by: Kalamkar, Snehanjali, et al.
Published: (2024)

Bend It, Aim It, Tap It: Designing an On-Body Disambiguation Mechanism for Curve Selection in Mixed Reality
by: Li, Xiang, et al.
Published: (2025)

Optimizing Curve-Based Selection with On-Body Surfaces in Virtual Environments
by: Li, Xiang, et al.
Published: (2025)

NoteEx: Interactive Visual Context Manipulation for LLM-Assisted Exploratory Data Analysis in Computational Notebooks
by: Payandeh, Mohammad Hasan, et al.
Published: (2025)

How Do We Evaluate Experiences in Immersive Environments?
by: Li, Xiang, et al.
Published: (2026)

Evaluating the Usability of Microgestures for Text Editing Tasks in Virtual Reality
by: Li, Xiang, et al.
Published: (2025)

Handows: A Palm-Based Interactive Multi-Window Management System in Virtual Reality
by: Wang, Jindu, et al.
Published: (2025)

LAPPI: Interactive Optimization with LLM-Assisted Preference-Based Problem Instantiation
by: Kuroki, So, et al.
Published: (2025)

Impact of Guidance and Interaction Strategies for LLM Use on Learner Performance and Perception
by: Kumar, Harsh, et al.
Published: (2023)

Cost-Aware Bayesian Optimization for Prototyping Interactive Devices
by: Langerak, Thomas, et al.
Published: (2026)

Hold Tight: Identifying Behavioral Patterns During Prolonged Work in VR through Video Analysis
by: Biener, Verena, et al.
Published: (2024)

LocoScooter: Designing a Stationary Scooter-Based Locomotion System for Navigation in Virtual Reality
by: He, Wei, et al.
Published: (2026)

AlphaPIG: The Nicest Way to Prolong Interactive Gestures in Extended Reality
by: Li, Yi, et al.
Published: (2025)

A Multi-Camera Optical Tag Neuronavigation and AR Augmentation Framework for Non-Invasive Brain Stimulation
by: Hu, Xuyi, et al.
Published: (2026)

Optical Tag-Based Neuronavigation and Augmentation System for Non-Invasive Brain Stimulation
by: Hu, Xuyi, et al.
Published: (2026)

LLM-Assisted Visual Analytics: Opportunities and Challenges
by: Hutchinson, Maeve, et al.
Published: (2024)

Challenges & Opportunities with LLM-Assisted Visualization Retargeting
by: Snyder, Luke S., et al.
Published: (2025)

Demystifying Reward Design in Reinforcement Learning for Upper Extremity Interaction: Practical Guidelines for Biomechanical Simulations in HCI
by: Selder, Hannah, et al.
Published: (2025)

Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences
by: Shankar, Shreya, et al.
Published: (2024)

Interactive Sketchpad: A Multimodal Tutoring System for Collaborative, Visual Problem-Solving
by: Chen, Steven-Shine, et al.
Published: (2025)

Utilizing Human Behavior Modeling to Manipulate Explanations in AI-Assisted Decision Making: The Good, the Bad, and the Scary
by: Li, Zhuoyan, et al.
Published: (2024)

InterChat: Enhancing Generative Visual Analytics using Multimodal Interactions
by: Chen, Juntong, et al.
Published: (2025)

AromaGen: Interactive Generation of Rich Olfactory Experiences with Multimodal Language Models
by: Wen, Yunge, et al.
Published: (2026)

SpaceBlender: Creating Context-Rich Collaborative Spaces Through Generative 3D Scene Blending
by: Numan, Nels, et al.
Published: (2024)

Swarm manipulation: An efficient and accurate technique for multi-object manipulation in virtual reality
by: Li, Xiang, et al.
Published: (2024)

Dark Patterns Meet GUI Agents: LLM Agent Susceptibility to Manipulative Interfaces and the Role of Human Oversight
by: Tang, Jingyu, et al.
Published: (2025)

Improving Steering and Verification in AI-Assisted Data Analysis with Interactive Task Decomposition
by: Kazemitabaar, Majeed, et al.
Published: (2024)

Pro$^2$Assist: Continuous Step-Aware Proactive Assistance with Multimodal Egocentric Perception for Long-Horizon Procedural Tasks
by: Xu, Lilin, et al.
Published: (2026)

Towards Human-AI Deliberation: Design and Evaluation of LLM-Empowered Deliberative AI for AI-Assisted Decision-Making
by: Ma, Shuai, et al.
Published: (2024)

The Interaction Layer: An Exploration for Co-Designing User-LLM Interactions in Parental Wellbeing Support Systems
by: Viswanathan, Sruthi, et al.
Published: (2024)