Cover Image

GUIDE: Graphical User Interface Data for Execution

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chawla, Rajat, Jha, Adarsh, Kumar, Muskaan, NS, Mukunda, Bhola, Ishaan
Format:	Preprint
Published:	2024
Subjects:	Human-Computer Interaction Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

V-Zen: Efficient GUI Understanding and Precise Grounding With A Novel Multimodal LLM
by: Rahman, Abdur, et al.
Published: (2024)

SuperCoder2.0: Technical Report on Exploring the feasibility of LLMs as Autonomous Programmer
by: Gautam, Anmol, et al.
Published: (2024)

AUTONODE: A Neuro-Graphic Self-Learnable Engine for Cognitive GUI Automation
by: Datta, Arkajit, et al.
Published: (2024)

Dynamic Planning for LLM-based Graphical User Interface Automation
by: Zhang, Shaoqing, et al.
Published: (2024)

Veagle: Advancements in Multimodal Representation Learning
by: Chawla, Rajat, et al.
Published: (2024)

Visual Grounding Methods for Efficient Interaction with Desktop Graphical User Interfaces
by: Ettifouri, El Hassane, et al.
Published: (2024)

TransBench: Breaking Barriers for Transferable Graphical User Interface Agents in Dynamic Digital Environments
by: Lu, Yuheng, et al.
Published: (2025)

Trained Miniatures: Low cost, High Efficacy SLMs for Sales & Marketing
by: Bhola, Ishaan, et al.
Published: (2025)

The Command Line GUIde: Graphical Interfaces from Man Pages via AI
by: Kasibatla, Saketh Ram, et al.
Published: (2025)

AI-Instruments: Embodying Prompts as Instruments to Abstract & Reflect Graphical Interface Commands as General-Purpose Tools
by: Riche, Nathalie, et al.
Published: (2025)

GUIDE: A Benchmark for Understanding and Assisting Users in Open-Ended GUI Tasks
by: Yang, Saelyne, et al.
Published: (2026)

Modeling User Preferences via Brain-Computer Interfacing
by: Leiva, Luis A., et al.
Published: (2024)

A Deep User Interface for Exploring LLaMa
by: Perumal, Divya, et al.
Published: (2025)

Heuristics for AI-driven Graphical Asset Generation Tools in Game Design and Development Pipelines: A User-Centred Approach
by: Fukaya, Kaisei, et al.
Published: (2025)

Large Language Models Meet User Interfaces: The Case of Provisioning Feedback
by: Pozdniakov, Stanislav, et al.
Published: (2024)

Human-Centered LLM-Agent User Interface: A Position Paper
by: Chin, Daniel, et al.
Published: (2024)

AgentBuilder: Exploring Scaffolds for Prototyping User Experiences of Interface Agents
by: Liang, Jenny T., et al.
Published: (2025)

Generative AI in Multimodal User Interfaces: Trends, Challenges, and Cross-Platform Adaptability
by: Bieniek, J., et al.
Published: (2024)

Graph4GUI: Graph Neural Networks for Representing Graphical User Interfaces
by: Jiang, Yue, et al.
Published: (2024)

Methodological Variation in Studying Staff and Student Perceptions of AI
by: Gerard, Juliana, et al.
Published: (2025)

Comparing LLM-Based Conversational and Graphical Interfaces for Industrial Decision Tasks: An Exploratory Mixed-Methods Study
by: Figliè, Roberto, et al.
Published: (2026)

MLLM as a UI Judge: Benchmarking Multimodal LLMs for Predicting Human Perception of User Interfaces
by: Luera, Reuben A., et al.
Published: (2025)

Insights into User Interface Innovations from a Design Thinking Workshop at deRSE25
by: Frank, Maximilian, et al.
Published: (2025)

How do Visual Attributes Influence Web Agents? A Comprehensive Evaluation of User Interface Design Factors
by: Yu, Kuai, et al.
Published: (2026)

Beyond Passive Viewing: A Pilot Study of a Hybrid Learning Platform Augmenting Video Lectures with Conversational AI
by: Abraar, Mohammed, et al.
Published: (2026)

Explanation User Interfaces: A Systematic Literature Review
by: Cappuccio, Eleonora, et al.
Published: (2025)

Cocoa: Co-Planning and Co-Execution with AI Agents
by: Feng, K. J. Kevin, et al.
Published: (2024)

Brief2Design: A Multi-phased, Compositional Approach to Prompt-based Graphic Design
by: Kikuchi, Kotaro, et al.
Published: (2026)

What's Next? Exploring Utilization, Challenges, and Future Directions of AI-Generated Image Tools in Graphic Design
by: Tang, Yuying, et al.
Published: (2024)

Agentic Enterprise: AI-Centric User to User-Centric AI
by: Narechania, Arpit, et al.
Published: (2025)

Prism: Mining Task-aware Domains in Non-i.i.d. IMU Data for Flexible User Perception
by: Li, Yunzhe, et al.
Published: (2025)

InsightGUIDE: An Opinionated AI Assistant for Guided Critical Reading of Scientific Literature
by: Koloveas, Paris, et al.
Published: (2025)

PREFINE: Personalized Story Generation via Simulated User Critics and User-Specific Rubric Generation
by: Ueda, Kentaro, et al.
Published: (2025)

RecUserSim: A Realistic and Diverse User Simulator for Evaluating Conversational Recommender Systems
by: Chen, Luyu, et al.
Published: (2025)

RealUserSim: Bridging the Reality Gap in Agent Benchmarking via Grounded User Simulation
by: Zhu, Ming, et al.
Published: (2026)

AgentEconomist: An End-to-end Agentic System Translating Economic Intuitions into Executable Computational Experiments
by: Chen, Jiaju, et al.
Published: (2026)

Why is the User Interface a Dark Pattern? : Explainable Auto-Detection and its Analysis
by: Yada, Yuki, et al.
Published: (2023)

Dukawalla: Voice Interfaces for Small Businesses in Africa
by: Ankrah, Elizabeth, et al.
Published: (2025)

SAGE: Smart home Agent with Grounded Execution
by: Rivkin, Dmitriy, et al.
Published: (2023)

Factors Impacting the Quality of User Answers on Smartphones
by: Bison, Ivano, et al.
Published: (2023)