Cover Image

Prototyping Multimodal GenAI Real-Time Agents with Counterfactual Replays and Hybrid Wizard-of-Oz

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Gmeiner, Frederic, Holstein, Kenneth, Martelaro, Nikolas
Format:	Preprint
Published:	2025
Subjects:	Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Exploring the Potential of Metacognitive Support Agents for Human-AI Co-Creation
by: Gmeiner, Frederic, et al.
Published: (2025)

Intent Tagging: Exploring Micro-Prompting Interactions for Supporting Granular Human-GenAI Co-Creation Workflows
by: Gmeiner, Frederic, et al.
Published: (2025)

Ceci N'est Pas un Drone: Investigating the Impact of Design Representation on Design Decision Making When Using GenAI
by: Xu, Zeda, et al.
Published: (2025)

Jigsaw: Supporting Designers to Prototype Multimodal Applications by Chaining AI Foundation Models
by: Lin, David Chuan-En, et al.
Published: (2023)

Wizard of Oz Experimentation for Language Technology Applications: Challenges and Tools
by: Schlögl, Stephan, et al.
Published: (2024)

How Do Data Analysts Respond to AI Assistance? A Wizard-of-Oz Study
by: Gu, Ken, et al.
Published: (2023)

Demonstrating PilotAR: A Tool to Assist Wizard-of-Oz Pilot Studies with OHMD
by: Janaka, Nuwan, et al.
Published: (2024)

GenAI Distortion: The Effect of GenAI Fluency and Positive Affect
by: Yang, Xiantong, et al.
Published: (2024)

SRWToolkit: An Open Source Wizard of Oz Toolkit to Create Social Robotic Avatars
by: Nilgar, Atikkhan Faridkhan, et al.
Published: (2025)

Evaluating Input Modalities for Pilot-Centered Taxiway Navigation: Insights from a Wizard-of-Oz Simulation
by: Mean, Chan Chea, et al.
Published: (2025)

Analysis and Detection of Differences in Spoken User Behaviors between Autonomous and Wizard-of-Oz Systems
by: Elmers, Mikey, et al.
Published: (2024)

Troubling Taxonomies in GenAI Evaluation
by: Berman, Glen, et al.
Published: (2024)

On LLM Wizards: Identifying Large Language Models' Behaviors for Wizard of Oz Experiments
by: Fang, Jingchao, et al.
Published: (2024)

PointAloud: An Interaction Suite for AI-Supported Pointer-Centric Think-Aloud Computing
by: Gmeiner, Frederic, et al.
Published: (2026)

Facilitating Human Feedback for GenAI Prompt Optimization
by: Sherson, Jacob, et al.
Published: (2024)

EcoAssist: Embedding Sustainability into AI-Assisted Frontend Development
by: Barrocas, André, et al.
Published: (2026)

Do Teachers Dream of GenAI Widening Educational (In)equality? Envisioning the Future of K-12 GenAI Education from Global Teachers' Perspectives
by: Xiao, Ruiwei, et al.
Published: (2025)

Dataset of GenAI-Assisted Information Problem Solving in Education
by: Li, Xinyu, et al.
Published: (2026)

Can GenAI Move from Individual Use to Collaborative Work? Experiences, Challenges, and Opportunities of Coordinating GenAI into Collaborative Newswork
by: Xiao, Qing, et al.
Published: (2025)

Scaffolding Flexible Ideation Workflows with AI in Creative Problem-Solving
by: Yang, Yaqing, et al.
Published: (2025)

Content Platform GenAI Regulation via Compensation
by: Chaimanowong, Wee
Published: (2026)

Augmenting Coaching with GenAI: Insights into Use, Effectiveness, and Future Potential
by: Haase, Jennifer
Published: (2025)

Designing a Lightweight GenAI Interface for Visual Data Analysis
by: Koonchanok, Ratanond, et al.
Published: (2025)

From Prompts to Reflection: Designing Reflective Play for GenAI Literacy
by: Ma, Qianou, et al.
Published: (2025)

The Fast and Spurious: Developer Productivity with GenAI
by: Afroz, Sadia, et al.
Published: (2025)

"We need to avail ourselves of GenAI to enhance knowledge distribution": Empowering Older Adults through GenAI Literacy
by: Ko, Eunhye Grace, et al.
Published: (2025)

Reimagining Legal Fact Verification with GenAI: Toward Effective Human-AI Collaboration
by: Han, Sirui, et al.
Published: (2026)

Helping or Homogenizing? GenAI as a Design Partner to Pre-Service SLPs for Just-in-Time Programming of AAC
by: Zastudil, Cynthia, et al.
Published: (2025)

The Emerging Use of GenAI for UX Research in Software Development: Challenges and Opportunities
by: Candello, Heloisa, et al.
Published: (2025)

Emerging Patterns of GenAI Use in K-12 Science and Mathematics Education
by: Esbenshade, Lief, et al.
Published: (2025)

Exploring the Design of GenAI-Based Systems to Support Socially Shared Metacognition
by: Zhao, Yihang, et al.
Published: (2026)

Thinking Less, Trusting More: GenAI's Impacts on Students' Cognitive Habits
by: Choudhuri, Rudrajit, et al.
Published: (2026)

Enhancing UX Research Activities Using GenAI -- Potential Applications and Challenges
by: Graser, Stefan, et al.
Published: (2024)

CodeExemplar: Example-Based Scaffolding for Introductory Programming in the GenAI Era
by: Ma, Boxuan, et al.
Published: (2026)

Framework for Adoption of Generative Artificial Intelligence (GenAI) in Education
by: Shailendra, Samar, et al.
Published: (2024)

Understanding User Privacy Perceptions of GenAI Smartphones
by: Jin, Ran, et al.
Published: (2026)

Does GenAI Make Usability Testing Obsolete?
by: Pourasad, Ali Ebrahimi, et al.
Published: (2024)

VideoMap: Supporting Video Editing Exploration, Brainstorming, and Prototyping in the Latent Space
by: Lin, David Chuan-En, et al.
Published: (2022)

GenLens: A Systematic Evaluation of Visual GenAI Model Outputs
by: Lin, Tica, et al.
Published: (2024)

GenAI Voice Mode in Programming Education
by: Jacobs, Sven, et al.
Published: (2025)