Cover Image

GhostUI: Unveiling Hidden Interactions in Mobile UI

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kweon, Minkyu, Park, Seokhyeon, Lee, Soohyun, Lee, You Been, Rhee, Jeongmin, Seo, Jinwook
Format:	Preprint
Published:	2026
Subjects:	Human-Computer Interaction Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Bridging Gulfs in UI Generation through Semantic Guidance
by: Park, Seokhyeon, et al.
Published: (2026)

HookLens: Visual Analytics for Understanding React Hooks Structures
by: Hwang, Suyeon, et al.
Published: (2026)

MAIC-UI: Making Interactive Courseware with Generative UI
by: Tu, Shangqing, et al.
Published: (2026)

Assessing Graphical Perception of Image Embedding Models using Channel Effectiveness
by: Lee, Soohyun, et al.
Published: (2024)

Leveraging Multimodal LLM for Inspirational User Interface Search
by: Park, Seokhyeon, et al.
Published: (2025)

InFerActive: Interactive Tree-Based Exploration of LLM Sampling for Safety Evaluation
by: Hwangbo, Junhyeong, et al.
Published: (2025)

AutoGameUI: Constructing High-Fidelity GameUI via Multimodal Correspondence Matching
by: Tang, Zhongliang, et al.
Published: (2024)

LlamaTouch: A Faithful and Scalable Testbed for Mobile UI Task Automation
by: Zhang, Li, et al.
Published: (2024)

Generative UI: LLMs are Effective UI Generators
by: Leviathan, Yaniv, et al.
Published: (2026)

Aria-UI: Visual Grounding for GUI Instructions
by: Yang, Yuhao, et al.
Published: (2024)

Extracting Human Attention through Crowdsourced Patch Labeling
by: Chang, Minsuk, et al.
Published: (2024)

UFO: A UI-Focused Agent for Windows OS Interaction
by: Zhang, Chaoyun, et al.
Published: (2024)

UI-UG: A Unified MLLM for UI Understanding and Generation
by: Yang, Hao, et al.
Published: (2025)

Efficiently Crowdsourcing Visual Importance with Punch-Hole Annotation
by: Chang, Minsuk, et al.
Published: (2024)

Can VLMs Assess Similarity Between Graph Visualizations?
by: Jung, Seokweon, et al.
Published: (2025)

Magentic-UI: Towards Human-in-the-loop Agentic Systems
by: Mozannar, Hussein, et al.
Published: (2025)

On AI-Inspired UI-Design
by: Wei, Jialiang, et al.
Published: (2024)

SPRITE: From Static Mockups to Engine-Ready Game UI
by: Bai, Yunshu, et al.
Published: (2026)

UISim: An Interactive Image-Based UI Simulator for Dynamic Mobile Environments
by: Xiang, Jiannan, et al.
Published: (2025)

FocusUI: Efficient UI Grounding via Position-Preserving Visual Token Selection
by: Ouyang, Mingyu, et al.
Published: (2026)

MLLM as a UI Judge: Benchmarking Multimodal LLMs for Predicting Human Perception of User Interfaces
by: Luera, Reuben A., et al.
Published: (2025)

FEAD: Figma-Enhanced App Design Framework for Improving UI/UX in Educational App Development
by: Huang, Tianyi
Published: (2024)

UI-TARS: Pioneering Automated GUI Interaction with Native Agents
by: Qin, Yujia, et al.
Published: (2025)

Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs
by: You, Keen, et al.
Published: (2024)

Intelligent Front-End Personalization: AI-Driven UI Adaptation
by: Rajhans, Mona
Published: (2026)

GUIrilla: A Scalable Framework for Automated Desktop UI Exploration
by: Garkot, Sofiya, et al.
Published: (2025)

ClickAgent: Enhancing UI Location Capabilities of Autonomous Agents
by: Hoscilowicz, Jakub, et al.
Published: (2024)

Predicting and Explaining Mobile UI Tappability with Vision Modeling and Saliency Analysis
by: Schoop, Eldon, et al.
Published: (2022)

CAAP: Context-Aware Action Planning Prompting to Solve Computer Tasks with Front-End UI Only
by: Cho, Junhee, et al.
Published: (2024)

UI Remix: Supporting UI Design Through Interactive Example Retrieval and Remixing
by: Wang, Junling, et al.
Published: (2026)

ReDemon UI: Reactive Synthesis by Demonstration for Web UI
by: Lee, Jay, et al.
Published: (2025)

The role of large language models in UI/UX design: A systematic literature review
by: Ahmed, Ammar, et al.
Published: (2025)

User-Centric Design of UI for Mobile Banking Apps: Improving UI and Features for Better Customer Experience
by: Chitrakar, Luniva, et al.
Published: (2026)

PhenoFlow: A Human-LLM Driven Visual Analytics System for Exploring Large and Complex Stroke Datasets
by: Kim, Jaeyoung, et al.
Published: (2024)

LikeThis! Empowering App Users to Submit UI Improvement Suggestions Instead of Complaints
by: Wei, Jialiang, et al.
Published: (2026)

ReFinE: Streamlining UI Mockup Iteration with Research Findings
by: Shin, Donghoon, et al.
Published: (2026)

Seeing Graphs Like Humans: Benchmarking Computational Measures and MLLMs for Similarity Assessment
by: Jung, Seokweon, et al.
Published: (2026)

Agent-Initiated Interaction in Phone UI Automation
by: Kahlon, Noam, et al.
Published: (2025)

ShowUI-$π$: Flow-based Generative Models as GUI Dexterous Hands
by: Hu, Siyuan, et al.
Published: (2025)

Human-Centered Explainability in AI-Enhanced UI Security Interfaces: Designing Trustworthy Copilots for Cybersecurity Analysts
by: Rajhans, Mona
Published: (2026)