Imagen de Portada

GUIrilla: A Scalable Framework for Automated Desktop UI Exploration

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Garkot, Sofiya, Shamrai, Maksym, Synytsia, Ivan, Hirna, Mariya
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Artificial Intelligence Human-Computer Interaction
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Screen2AX: Vision-Based Approach for Automatic macOS Accessibility Generation
por: Muryn, Viktor, et al.
Publicado: (2025)

Generative UI: LLMs are Effective UI Generators
por: Leviathan, Yaniv, et al.
Publicado: (2026)

ClickAgent: Enhancing UI Location Capabilities of Autonomous Agents
por: Hoscilowicz, Jakub, et al.
Publicado: (2024)

LlamaTouch: A Faithful and Scalable Testbed for Mobile UI Task Automation
por: Zhang, Li, et al.
Publicado: (2024)

Scalable Exploration via Ensemble++
por: Li, Yingru, et al.
Publicado: (2024)

A Conversational Brain-Artificial Intelligence Interface
por: Meunier, Anja, et al.
Publicado: (2024)

UI-JEPA: Towards Active Perception of User Intent through Onscreen User Activity
por: Fu, Yicheng, et al.
Publicado: (2024)

Known By Their Actions: Fingerprinting LLM Browser Agents via UI Traces
por: Lugoloobi, William, et al.
Publicado: (2026)

Automating the loop in traffic incident management on highway
por: Cercola, Matteo, et al.
Publicado: (2025)

ff4ERA: A new Fuzzy Framework for Ethical Risk Assessment in AI
por: Dyoub, Abeer, et al.
Publicado: (2025)

Predicting and Explaining Mobile UI Tappability with Vision Modeling and Saliency Analysis
por: Schoop, Eldon, et al.
Publicado: (2022)

ABScribe: Rapid Exploration & Organization of Multiple Writing Variations in Human-AI Co-Writing Tasks using Large Language Models
por: Reza, Mohi, et al.
Publicado: (2023)

GhostUI: Unveiling Hidden Interactions in Mobile UI
por: Kweon, Minkyu, et al.
Publicado: (2026)

ADEPTS: A Capability Framework for Human-Centered Agent Design
por: D'Oro, Pierluca, et al.
Publicado: (2025)

The Model Mastery Lifecycle: A Framework for Designing Human-AI Interaction
por: Chignell, Mark, et al.
Publicado: (2024)

Do It For Me vs. Do It With Me: Investigating User Perceptions of Different Paradigms of Automation in Copilots for Feature-Rich Software
por: Khurana, Anjali, et al.
Publicado: (2025)

AURA: A Reinforcement Learning Framework for AI-Driven Adaptive Conversational Surveys
por: Tang, Jinwen, et al.
Publicado: (2025)

Collaborative Intelligence in Sequential Experiments: A Human-in-the-Loop Framework for Drug Discovery
por: He, Jinghai, et al.
Publicado: (2024)

STOOD-X methodology: using statistical nonparametric test for OOD Detection Large-Scale datasets enhanced with explainability
por: Sevillano-García, Iván, et al.
Publicado: (2025)

A Pain Assessment Framework based on multimodal data and Deep Machine Learning methods
por: Gkikas, Stefanos
Publicado: (2025)

Human-Centered Explainable AI for Security Enhancement: A Deep Intrusion Detection Framework
por: Ayan, Md Muntasir Jahid, et al.
Publicado: (2026)

COMFORT: A Continual Fine-Tuning Framework for Foundation Models Targeted at Consumer Healthcare
por: Li, Chia-Hao, et al.
Publicado: (2024)

MetaExplainer: A Framework to Generate Multi-Type User-Centered Explanations for AI Systems
por: Chari, Shruthi, et al.
Publicado: (2025)

Efficient Human-in-the-Loop Active Learning: A Novel Framework for Data Labeling in AI Systems
por: Huang, Yiran, et al.
Publicado: (2024)

A Multi-Component AI Framework for Computational Psychology: From Robust Predictive Modeling to Deployed Generative Dialogue
por: Pareek, Anant
Publicado: (2025)

TutoAI: A Cross-domain Framework for AI-assisted Mixed-media Tutorial Creation on Physical Tasks
por: Chen, Yuexi, et al.
Publicado: (2024)

Towards Automated Error Discovery: A Study in Conversational AI
por: Petrak, Dominic, et al.
Publicado: (2025)

Designing Interpretable ML System to Enhance Trust in Healthcare: A Systematic Review to Proposed Responsible Clinician-AI-Collaboration Framework
por: Nasarian, Elham, et al.
Publicado: (2023)

Deep Language Geometry: Constructing a Metric Space from LLM Weights
por: Shamrai, Maksym, et al.
Publicado: (2025)

AutoGameUI: Constructing High-Fidelity GameUI via Multimodal Correspondence Matching
por: Tang, Zhongliang, et al.
Publicado: (2024)

TopoPilot: Reliable Conversational Workflow Automation for Topological Data Analysis and Visualization
por: Gorski, Nathaniel, et al.
Publicado: (2026)

Visual Grounding Methods for Efficient Interaction with Desktop Graphical User Interfaces
por: Ettifouri, El Hassane, et al.
Publicado: (2024)

Automating Customer Needs Analysis: A Comparative Study of Large Language Models in the Travel Industry
por: Barandoni, Simone, et al.
Publicado: (2024)

Comparing Exploration-Exploitation Strategies of LLMs and Humans: Insights from Standard Multi-armed Bandit Experiments
por: Zhang, Ziyuan, et al.
Publicado: (2025)

MAIC-UI: Making Interactive Courseware with Generative UI
por: Tu, Shangqing, et al.
Publicado: (2026)

Augmenting Automation: Intent-Based User Instruction Classification with Machine Learning
por: Basyal, Lochan, et al.
Publicado: (2024)

UISim: An Interactive Image-Based UI Simulator for Dynamic Mobile Environments
por: Xiang, Jiannan, et al.
Publicado: (2025)

FEAD: Figma-Enhanced App Design Framework for Improving UI/UX in Educational App Development
por: Huang, Tianyi
Publicado: (2024)

Automated Assessment of Encouragement and Warmth in Classrooms Leveraging Multimodal Emotional Features and ChatGPT
por: Hou, Ruikun, et al.
Publicado: (2024)

Exploration of LLMs, EEG, and behavioral data to measure and support attention and sleep
por: Sano, Akane, et al.
Publicado: (2024)