Image de couverture de livre

GraphPilot: GUI Task Automation with One-Step LLM Reasoning Powered by Knowledge Graph

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Yu, Mingxian, Luo, Siqi, Chen, Xu
Format:	Preprint
Publié:	2026
Sujets:	Human-Computer Interaction
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

LLM-Powered GUI Agents in Phone Automation: Surveying Progress and Prospects
par: Liu, Guangyi, et autres
Publié: (2025)

CRAFT-GUI: Curriculum-Reinforced Agent For GUI Tasks
par: Nong, Songqin, et autres
Publié: (2025)

The Behavioral Fabric of LLM-Powered GUI Agents: Human Values and Interaction Outcomes
par: Gebreegziabher, Simret Araya, et autres
Publié: (2026)

TaskSense: Cognitive Chain Modeling and Difficulty Estimation for GUI Tasks
par: Yin, Yiwen, et autres
Publié: (2025)

Knowledge Synthesis Graph: An LLM-Based Approach for Modeling Student Collaborative Discourse
par: Shui, Bo, et autres
Publié: (2026)

GraphTide: Augmenting Knowledge-Intensive Text with Progressive Nested Graph
par: Qian, Xin, et autres
Publié: (2026)

Smoothing Grounding and Reasoning for MLLM-Powered GUI Agents with Query-Oriented Pivot Tasks
par: Wu, Zongru, et autres
Publié: (2025)

Mitigating LLM Hallucinations with Knowledge Graphs: A Case Study
par: Li, Harry, et autres
Publié: (2025)

VisionTasker: Mobile Task Automation Using Vision Based UI Understanding and LLM Task Planning
par: Song, Yunpeng, et autres
Publié: (2023)

Limitations of the LLM-as-a-Judge Approach for Evaluating LLM Outputs in Expert Knowledge Tasks
par: Szymanski, Annalisa, et autres
Publié: (2024)

Improving Data Quality via Pre-Task Participant Screening in Crowdsourced GUI Experiments
par: Miyama, Takaya, et autres
Publié: (2026)

Toward a Human-Centered Evaluation Framework for Trustworthy LLM-Powered GUI Agents
par: Chen, Chaoran, et autres
Publié: (2025)

The Obvious Invisible Threat: LLM-Powered GUI Agents' Vulnerability to Fine-Print Injections
par: Chen, Chaoran, et autres
Publié: (2025)

Natural Language Interaction for Editing Visual Knowledge Graphs
par: Shahriari, Reza, et autres
Publié: (2025)

Improving Knowledge Graph Understanding with Contextual Views -- Extended
par: Christou, Antrea, et autres
Publié: (2025)

AutoGraph: A Knowledge-Graph Framework for Modeling Interface Interaction and Automating Procedure Execution in Digital Nuclear Control Rooms
par: Xiao, Xingyu, et autres
Publié: (2025)

KNOWNET: Guided Health Information Seeking from LLMs via Knowledge Graph Integration
par: Yan, Youfu, et autres
Publié: (2024)

DAVIS: Planning Agent with Knowledge Graph-Powered Inner Monologue
par: Dinh, Minh Pham, et autres
Publié: (2024)

OS-Genesis: Automating GUI Agent Trajectory Construction via Reverse Task Synthesis
par: Sun, Qiushi, et autres
Publié: (2024)

WhatIf: Interactive Exploration of LLM-Powered Social Simulations for Policy Reasoning
par: Li, Yuxuan, et autres
Publié: (2026)

SSKG Hub: An Expert-Guided Platform for LLM-Empowered Sustainability Standards Knowledge Graphs
par: He, Chaoyue, et autres
Publié: (2026)

Prompt2Task: Automating UI Tasks on Smartphones from Textual Prompts
par: Huang, Tian, et autres
Publié: (2024)

Guiding Generative Storytelling with Knowledge Graphs
par: Pan, Zhijun, et autres
Publié: (2025)

Agreeing and Disagreeing in Collaborative Knowledge Graph Construction: An Analysis of Wikidata
par: Koutsiana, Elisavet, et autres
Publié: (2023)

Visualization Tasks for Unlabeled Graphs
par: Oddo, Matt I. B., et autres
Publié: (2025)

A User-Centered Teleoperation GUI for Automated Vehicles: Identifying and Evaluating Information Requirements for Remote Driving and Assistance
par: Wolf, Maria-Magdalena, et autres
Publié: (2025)

TinyClick: Single-Turn Agent for Empowering GUI Automation
par: Pawlowski, Pawel, et autres
Publié: (2024)

Advancing GUI for Generative AI: Charting the Design Space of Human-AI Interactions through Task Creativity and Complexity
par: Ding, Zijian
Publié: (2024)

PG-Agent: An Agent Powered by Page Graph
par: Chen, Weizhi, et autres
Publié: (2025)

Beyond Clicking:A Step Towards Generalist GUI Grounding via Text Dragging
par: Liao, Zeyi, et autres
Publié: (2025)

OS-Kairos: Adaptive Interaction for MLLM-Powered GUI Agents
par: Cheng, Pengzhou, et autres
Publié: (2025)

A Survey on (M)LLM-Based GUI Agents
par: Tang, Fei, et autres
Publié: (2025)

A Preliminary Roadmap for LLMs as Assistants in Exploring, Analyzing, and Visualizing Knowledge Graphs
par: Li, Harry, et autres
Publié: (2024)

Building Autonomous GUI Navigation via Agentic-Q Estimation and Step-Wise Policy Optimization
par: Wang, Yibo, et autres
Publié: (2026)

SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents
par: Cheng, Kanzhi, et autres
Publié: (2024)

Aria-UI: Visual Grounding for GUI Instructions
par: Yang, Yuhao, et autres
Publié: (2024)

Improving Factuality for Dialogue Response Generation via Graph-Based Knowledge Augmentation
par: Chen, Xiangyan, et autres
Publié: (2025)

Seeing the Reasoning: How LLM Rationales Influence User Trust and Decision-Making in Factual Verification Tasks
par: Sun, Xin, et autres
Publié: (2026)

The Role of Visualization in LLM-Assisted Knowledge Graph Systems: Effects on User Trust, Exploration, and Workflows
par: Li, Harry, et autres
Publié: (2025)

LLM-Assisted Knowledge Graph Completion for Curriculum and Domain Modelling in Personalized Higher Education Recommendations
par: Abu-Rasheed, Hasan, et autres
Publié: (2025)