Imagen de Portada

UFO: A UI-Focused Agent for Windows OS Interaction

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zhang, Chaoyun, Li, Liqun, He, Shilin, Zhang, Xu, Qiao, Bo, Qin, Si, Ma, Minghua, Kang, Yu, Lin, Qingwei, Rajmohan, Saravan, Zhang, Dongmei, Zhang, Qi
Formato:	Preprint
Publicado:	2024
Materias:	Human-Computer Interaction Artificial Intelligence Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

API Agents vs. GUI Agents: Divergence and Convergence
por: Zhang, Chaoyun, et al.
Publicado: (2025)

UFO2: The Desktop AgentOS
por: Zhang, Chaoyun, et al.
Publicado: (2025)

Large Language Model-Brained GUI Agents: A Survey
por: Zhang, Chaoyun, et al.
Publicado: (2024)

UFO3: Weaving the Digital Agent Galaxy
por: Zhang, Chaoyun, et al.
Publicado: (2025)

Navigating the Unknown: A Chat-Based Collaborative Interface for Personalized Exploratory Tasks
por: Peng, Yingzhe, et al.
Publicado: (2024)

Risk-aware Adaptive Virtual CPU Oversubscription in Microsoft Cloud via Prototypical Human-in-the-loop Imitation Learning
por: Wang, Lu, et al.
Publicado: (2024)

MAIC-UI: Making Interactive Courseware with Generative UI
por: Tu, Shangqing, et al.
Publicado: (2026)

Optimizing Gesture Recognition for Seamless UI Interaction Using Convolutional Neural Networks
por: Sun, Qi, et al.
Publicado: (2024)

Agent-Initiated Interaction in Phone UI Automation
por: Kahlon, Noam, et al.
Publicado: (2025)

Macaron-A2UI: A Model for Generative UI in Personal Agents
por: Kong, Fancy, et al.
Publicado: (2026)

UI-Evol: Automatic Knowledge Evolving for Computer Use Agents
por: Zhang, Ziyun, et al.
Publicado: (2025)

Focus Agent: LLM-Powered Virtual Focus Group
por: Zhang, Taiyu, et al.
Publicado: (2024)

From Interaction to Impact: Towards Safer AI Agents Through Understanding and Evaluating Mobile UI Operation Impacts
por: Zhang, Zhuohao Jerry, et al.
Publicado: (2024)

ProactiveVA: Proactive Visual Analytics with LLM-Based UI Agent
por: Zhao, Yuheng, et al.
Publicado: (2025)

UI Remix: Supporting UI Design Through Interactive Example Retrieval and Remixing
por: Wang, Junling, et al.
Publicado: (2026)

OS-Kairos: Adaptive Interaction for MLLM-Powered GUI Agents
por: Cheng, Pengzhou, et al.
Publicado: (2025)

GhostUI: Unveiling Hidden Interactions in Mobile UI
por: Kweon, Minkyu, et al.
Publicado: (2026)

Misty: UI Prototyping Through Interactive Conceptual Blending
por: Lu, Yuwen, et al.
Publicado: (2024)

Automated UI Interface Generation via Diffusion Models: Enhancing Personalization and Efficiency
por: Duan, Yifei, et al.
Publicado: (2025)

Open WebUI: An Open, Extensible, and Usable Interface for AI Interaction
por: Baek, Jaeryang, et al.
Publicado: (2025)

Large Language Models can Deliver Accurate and Interpretable Time Series Anomaly Detection
por: Liu, Jun, et al.
Publicado: (2024)

AutoGameUI: Constructing High-Fidelity GameUI via Multimodal Correspondence Matching
por: Tang, Zhongliang, et al.
Publicado: (2024)

UI-TARS: Pioneering Automated GUI Interaction with Native Agents
por: Qin, Yujia, et al.
Publicado: (2025)

Efficient and Aesthetic UI Design with a Deep Learning-Based Interface Generation Tree Algorithm
por: Duan, Shiyu, et al.
Publicado: (2024)

FocusFlow: 3D Gaze-Depth Interaction in Virtual Reality Leveraging Active Visual Depth Manipulation
por: Zhang, Chenyang, et al.
Publicado: (2024)

Privacy Starts with UI: Privacy Patterns and Designer Perspectives in UI/UX Practice
por: Maloku, Anxhela, et al.
Publicado: (2026)

Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs
por: You, Keen, et al.
Publicado: (2024)

CrowdGenUI: Aligning LLM-Based UI Generation with Crowdsourced User Preferences
por: Liu, Yimeng, et al.
Publicado: (2024)

Exploring the Role of Interaction Data to Empower End-User Decision-Making In UI Personalization
por: Alves, Sérgio, et al.
Publicado: (2026)

The GenUI Study: Exploring the Design of Generative UI Tools to Support UX Practitioners and Beyond
por: Chen, Xiang 'Anthony', et al.
Publicado: (2025)

SpecifyUI: Supporting Iterative UI Design Intent Expression through Structured Specifications and Generative AI
por: Chen, Yunnong, et al.
Publicado: (2025)

User-Centric Design of UI for Mobile Banking Apps: Improving UI and Features for Better Customer Experience
por: Chitrakar, Luniva, et al.
Publicado: (2026)

MUD: Towards a Large-Scale and Noise-Filtered UI Dataset for Modern Style UI Modeling
por: Feng, Sidong, et al.
Publicado: (2024)

What is the focus of XAI in UI design? Prioritizing UI design principles for enhancing XAI user experience
por: Lei, Dian, et al.
Publicado: (2024)

FocusUI: Efficient UI Grounding via Position-Preserving Visual Token Selection
por: Ouyang, Mingyu, et al.
Publicado: (2026)

DuetUI: A Bidirectional Context Loop for Human-Agent Co-Generation of Task-Oriented Interfaces
por: Xu, Yuan, et al.
Publicado: (2025)

Zipage: Maintain High Request Concurrency for LLM Reasoning through Compressed PagedAttention
por: Liao, Mengqi, et al.
Publicado: (2026)

Break the Window: Exploring Spatial Decomposition of Webpages in XR
por: Zhang, Chenyang, et al.
Publicado: (2026)

UI-E2I-Synth: Advancing GUI Grounding with Large-Scale Instruction Synthesis
por: Liu, Xinyi, et al.
Publicado: (2025)

Preference-Guided Multi-Objective UI Adaptation
por: Song, Yao, et al.
Publicado: (2025)