Cover Image

UINav: A Practical Approach to Train On-Device Automation Agents

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Wei, Hsu, Fu-Lin, Bishop, Will, Campbell-Ajala, Folawiyo, Lin, Max, Riva, Oriana
Format:	Preprint
Published:	2023
Subjects:	Human-Computer Interaction Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

On the Effects of Data Scale on UI Control Agents
by: Li, Wei, et al.
Published: (2024)

The Architecture of Cognitive Amplification: Enhanced Cognitive Scaffolding as a Resolution to the Comfort-Growth Paradox in Human-AI Cognitive Integration
by: Riva, Giuseppe
Published: (2025)

Invisible Architectures of Thought: Toward a New Science of AI as Cognitive Infrastructure
by: Riva, Giuseppe
Published: (2025)

Agent-Initiated Interaction in Phone UI Automation
by: Kahlon, Noam, et al.
Published: (2025)

Enhancing Human Experience in Human-Agent Collaboration: A Human-Centered Modeling Approach Based on Positive Human Gain
by: Gao, Yiming, et al.
Published: (2024)

API Agents vs. GUI Agents: Divergence and Convergence
by: Zhang, Chaoyun, et al.
Published: (2025)

AppAgent v2: Advanced Agent for Flexible Mobile Interactions
by: Li, Yanda, et al.
Published: (2024)

MapAgent: Trajectory-Constructed Memory-Augmented Planning for Mobile Task Automation
by: Kong, Yi, et al.
Published: (2025)

Affordable Generative Agents
by: Yu, Yangbin, et al.
Published: (2024)

TinyClick: Single-Turn Agent for Empowering GUI Automation
by: Pawlowski, Pawel, et al.
Published: (2024)

MobileExperts: A Dynamic Tool-Enabled Agent Team in Mobile Devices
by: Zhang, Jiayi, et al.
Published: (2024)

A Framework for Longitudinal Health AI Agents
by: Lin, Georgianna, et al.
Published: (2026)

Sensor-Based Data Acquisition via Ubiquitous Device to Detect Muscle Strength Training Activities
by: Wianto, E., et al.
Published: (2024)

A Multi-Agent Large Language Model Framework for Automated Qualitative Analysis
by: Xu, Qidi, et al.
Published: (2025)

Toward Youth-Centered Privacy-by-Design in Smart Devices: A Systematic Review
by: Campbell, Molly, et al.
Published: (2026)

CellAgent: An LLM-driven Multi-Agent Framework for Automated Single-cell Data Analysis
by: Xiao, Yihang, et al.
Published: (2024)

SheetMind: An End-to-End LLM-Powered Multi-Agent Framework for Spreadsheet Automation
by: Zhu, Ruiyan, et al.
Published: (2025)

PG-Agent: An Agent Powered by Page Graph
by: Chen, Weizhi, et al.
Published: (2025)

Design Generative AI for Practitioners: Exploring Interaction Approaches Aligned with Creative Practice
by: Peng, Xiaohan, et al.
Published: (2026)

Socially Interactive Agents for Robotic Neurorehabilitation Training: Conceptualization and Proof-of-concept Study
by: Arora, Rhythm, et al.
Published: (2024)

OmniGUI: Benchmarking GUI Agents in Omni-Modal Smartphone Environments
by: Henry, Felix, et al.
Published: (2026)

Exploring Conversational Design Choices in LLMs for Pedagogical Purposes: Socratic and Narrative Approaches for Improving Instructor's Teaching Practice
by: Chen, Si, et al.
Published: (2025)

MagicAgent: Towards Generalized Agent Planning
by: Ren, Xuhui, et al.
Published: (2026)

A Multi-Agent Conversational Bandit Approach to Online Evaluation and Selection of User-Aligned LLM Responses
by: Dai, Xiangxiang, et al.
Published: (2025)

An Intelligent AI glasses System with Multi-Agent Architecture for Real-Time Voice Processing and Task Execution
by: Chen, Sheng-Kai, et al.
Published: (2026)

The Dearth of the Author in AI-Supported Writing
by: Kreminski, Max
Published: (2024)

Automated Interpretability and Feature Discovery in Language Models with Agents
by: Marin-Llobet, Arnau, et al.
Published: (2026)

Do Tutors Learn from Equity Training and Can Generative AI Assess It?
by: Thomas, Danielle R., et al.
Published: (2024)

Exploring Teachers' Perspectives on Using Conversational AI Agents for Group Collaboration
by: Ravi, Prerna, et al.
Published: (2026)

Optimizing SIA Development: A Case Study in User-Centered Design for Estuary, a Multimodal Socially Interactive Agent Framework
by: Lin, Spencer, et al.
Published: (2025)

Context-Aware Visual Prompting: Automating Geospatial Web Dashboards with Large Language Models and Agent Self-Validation for Decision Support
by: Xu, Haowen, et al.
Published: (2025)

UICrit: Enhancing Automated Design Evaluation with a UICritique Dataset
by: Duan, Peitong, et al.
Published: (2024)

Beyond Levels of Driving Automation: A Triadic Framework of Human-AI Collaboration in On-Road Mobility
by: Huang, Gaojian, et al.
Published: (2025)

InnerPond: Fostering Inter-Self Dialogue with a Multi-Agent Approach for Introspection
by: Jeon, Hayeon, et al.
Published: (2026)

PRISM: Festina Lente Proactivity -- Risk-Sensitive, Uncertainty-Aware Deliberation for Proactive Agents
by: Fu, Yuxuan, et al.
Published: (2026)

AgentLens: Visual Analysis for Agent Behaviors in LLM-based Autonomous Systems
by: Lu, Jiaying, et al.
Published: (2024)

MobileAgentBench: An Efficient and User-Friendly Benchmark for Mobile LLM Agents
by: Wang, Luyuan, et al.
Published: (2024)

InfiAgent: Self-Evolving Pyramid Agent Framework for Infinite Scenarios
by: Yu, Chenglin, et al.
Published: (2025)

Do Students with Different Personality Traits Demonstrate Different Physiological Signals in Video-based Learning?
by: Tseng, Chun-Hsiung, et al.
Published: (2024)

Human-Centered Automation
by: Toxtli, Carlos
Published: (2024)