Cover Image

GPTVoiceTasker: Advancing Multi-step Mobile Task Efficiency Through Dynamic Interface Exploration and Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Vu, Minh Duc, Wang, Han, Li, Zhuang, Chen, Jieshan, Zhao, Shengdong, Xing, Zhenchang, Chen, Chunyang
Format:	Preprint
Published:	2024
Subjects:	Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Unveiling the Tricks: Automated Detection of Dark Patterns in Mobile Applications
by: Chen, Jieshan, et al.
Published: (2023)

FactFlow: Automatic Fact Sheet Generation and Customization from Tabular Dataset via AI Chain Design & Implementation
by: Vu, Minh Duc, et al.
Published: (2025)

VisionTasker: Mobile Task Automation Using Vision Based UI Understanding and LLM Task Planning
by: Song, Yunpeng, et al.
Published: (2023)

A Case Study of Scalable Content Annotation Using Multi-LLM Consensus and Human Review
by: Yuan, Mingyue, et al.
Published: (2025)

From Exploration to Revelation: Detecting Dark Patterns in Mobile Apps
by: Chen, Jieshan, et al.
Published: (2024)

MAxPrototyper: A Multi-Agent Generation System for Interactive User Interface Prototyping
by: Yuan, Mingyue, et al.
Published: (2024)

Towards Human-AI Synergy in UI Design: Supporting Iterative Generation with LLMs
by: Yuan, Mingyue, et al.
Published: (2024)

Exploring the Effect of Viewing Attributes of Mobile AR Interfaces on Remote Collaborative and Competitive Tasks
by: Nugegoda, Nelusha, et al.
Published: (2025)

Unblind Text Inputs: Predicting Hint-text of Text Input in Mobile Apps via LLM
by: Liu, Zhe, et al.
Published: (2024)

MUD: Towards a Large-Scale and Noise-Filtered UI Dataset for Modern Style UI Modeling
by: Feng, Sidong, et al.
Published: (2024)

Exploring the potential of AI in nurturing learner empathy, prosocial values and environmental stewardship
by: Lim, Kenneth Y T, et al.
Published: (2024)

Artographer: a Curatorial Interface for Art Space Exploration
by: Almeda, Shm Garanganao, et al.
Published: (2025)

2024 NASA SUITS Report: LLM-Driven Immersive Augmented Reality User Interface for Robotics and Space Exploration
by: Zhuang, Kathy, et al.
Published: (2025)

EvAlignUX: Advancing UX Evaluation through LLM-Supported Metrics Exploration
by: Zheng, Qingxiao, et al.
Published: (2024)

Collective Creation of Intimacy: Exploring the Cosplay Commission Practice within the Otome Game Community in China
by: Zhou, Yihao, et al.
Published: (2024)

Hierarchical Resource Rationality Explains Human Reading Behavior
by: Bai, Yunpeng, et al.
Published: (2026)

Demonstrating PilotAR: A Tool to Assist Wizard-of-Oz Pilot Studies with OHMD
by: Janaka, Nuwan, et al.
Published: (2024)

Layered Interactions: Exploring Non-Intrusive Digital Craftsmanship Design Through Lacquer Art Interfaces
by: Dong, Yan, et al.
Published: (2025)

Independence in the Home: A Wearable Interface for a Person with Quadriplegia to Teleoperate a Mobile Manipulator
by: Padmanabha, Akhil, et al.
Published: (2023)

PersonaMail: Learning and Adapting Personal Communication Preferences for Context-Aware Email Writing
by: Yao, Rui, et al.
Published: (2026)

TaskLens: Generating Task-Conditioned Scaffolded Interfaces for Learning Professional Creative Software
by: Liu, Yimeng, et al.
Published: (2025)

OnomaCompass: A Texture Exploration Interface that Shuttles between Words and Images
by: Okamura, Miki, et al.
Published: (2026)

''I don't want to break it'': An Exploration of Perceived Fragility in Shape-Changing Interfaces
by: Mackamul, Eva, et al.
Published: (2026)

Advancing Building Energy Modeling with Large Language Models: Exploration and Case Studies
by: Zhang, Liang, et al.
Published: (2024)

ReTrace: Interactive Visualizations for Reasoning Traces of Large Reasoning Models
by: Felder, Ludwig, et al.
Published: (2025)

SelfIE: Self-Initiated Explorable Instructions Towards Enhanced User Experience
by: Kim, Hyeongcheol, et al.
Published: (2024)

Simulation-based Optimization for Augmented Reading
by: Bai, Yunpeng, et al.
Published: (2026)

MarioChart: Autonomous Tangibles as Active Proxy Interfaces for Embodied Casual Data Exploration
by: Dai, Shaozhang, et al.
Published: (2026)

VergeIO: Depth-Aware Eye Interaction on Glasses
by: Zhang, Xiyuxing, et al.
Published: (2025)

Advancing VR Simulators for Autonomous Vehicle-Pedestrian Interactions: A Focus on Multi-Entity Scenarios
by: Tran, Tram Thi Minh, et al.
Published: (2024)

AppAgent v2: Advanced Agent for Flexible Mobile Interactions
by: Li, Yanda, et al.
Published: (2024)

Automated UI Interface Generation via Diffusion Models: Enhancing Personalization and Efficiency
by: Duan, Yifei, et al.
Published: (2025)

A Tangible Multi-Display Toolkit to Support the Collaborative Design Exploration of AV-Pedestrian Interfaces
by: Hoggenmuller, Marius, et al.
Published: (2024)

Empowering Mobility: Brain-Computer Interface for Enhancing Wheelchair Control for Individuals with Physical Disabilities
by: Ghasemi, Shiva, et al.
Published: (2024)

Adaptive Human-Computer Interaction Strategies Through Reinforcement Learning in Complex
by: Liu, Rui, et al.
Published: (2025)

AgentClick: A Skill-Based Human-in-the-Loop Review Layer for Terminal AI Agents
by: Zhuang, Haomin, et al.
Published: (2026)

DuoDrama: Supporting Screenplay Refinement Through LLM-Assisted Human Reflection
by: Tang, Yuying, et al.
Published: (2026)

Exploring the Impact of Interconnected External Interfaces in Autonomous Vehicleson Pedestrian Safety and Experience
by: Tran, Tram Thi Minh, et al.
Published: (2024)

Touching Space: Accessible Map Exploration Through Conversational Audio-Haptic Interaction
by: Liu, Li, et al.
Published: (2026)

Learning Password Best Practices Through In-Task Instruction
by: Ma, Qian, et al.
Published: (2026)