Cover Image

AutoGameUI: Constructing High-Fidelity GameUI via Multimodal Correspondence Matching

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tang, Zhongliang, Cheng, Qingrong, Tan, Mengchen, Zhang, Yongxiang, Xia, Fei
Format:	Preprint
Published:	2024
Subjects:	Human-Computer Interaction Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SPRITE: From Static Mockups to Engine-Ready Game UI
by: Bai, Yunshu, et al.
Published: (2026)

GhostUI: Unveiling Hidden Interactions in Mobile UI
by: Kweon, Minkyu, et al.
Published: (2026)

MAIC-UI: Making Interactive Courseware with Generative UI
by: Tu, Shangqing, et al.
Published: (2026)

Magentic-UI: Towards Human-in-the-loop Agentic Systems
by: Mozannar, Hussein, et al.
Published: (2025)

Generative UI: LLMs are Effective UI Generators
by: Leviathan, Yaniv, et al.
Published: (2026)

Aria-UI: Visual Grounding for GUI Instructions
by: Yang, Yuhao, et al.
Published: (2024)

On AI-Inspired UI-Design
by: Wei, Jialiang, et al.
Published: (2024)

UI-UG: A Unified MLLM for UI Understanding and Generation
by: Yang, Hao, et al.
Published: (2025)

Bridging Gulfs in UI Generation through Semantic Guidance
by: Park, Seokhyeon, et al.
Published: (2026)

MLLM as a UI Judge: Benchmarking Multimodal LLMs for Predicting Human Perception of User Interfaces
by: Luera, Reuben A., et al.
Published: (2025)

FocusUI: Efficient UI Grounding via Position-Preserving Visual Token Selection
by: Ouyang, Mingyu, et al.
Published: (2026)

LlamaTouch: A Faithful and Scalable Testbed for Mobile UI Task Automation
by: Zhang, Li, et al.
Published: (2024)

GameVibe: A Multimodal Affective Game Corpus
by: Barthet, Matthew, et al.
Published: (2024)

FEAD: Figma-Enhanced App Design Framework for Improving UI/UX in Educational App Development
by: Huang, Tianyi
Published: (2024)

GUIrilla: A Scalable Framework for Automated Desktop UI Exploration
by: Garkot, Sofiya, et al.
Published: (2025)

Intelligent Front-End Personalization: AI-Driven UI Adaptation
by: Rajhans, Mona
Published: (2026)

UFO: A UI-Focused Agent for Windows OS Interaction
by: Zhang, Chaoyun, et al.
Published: (2024)

ClickAgent: Enhancing UI Location Capabilities of Autonomous Agents
by: Hoscilowicz, Jakub, et al.
Published: (2024)

CAAP: Context-Aware Action Planning Prompting to Solve Computer Tasks with Front-End UI Only
by: Cho, Junhee, et al.
Published: (2024)

Known By Their Actions: Fingerprinting LLM Browser Agents via UI Traces
by: Lugoloobi, William, et al.
Published: (2026)

LikeThis! Empowering App Users to Submit UI Improvement Suggestions Instead of Complaints
by: Wei, Jialiang, et al.
Published: (2026)

The role of large language models in UI/UX design: A systematic literature review
by: Ahmed, Ammar, et al.
Published: (2025)

UI-JEPA: Towards Active Perception of User Intent through Onscreen User Activity
by: Fu, Yicheng, et al.
Published: (2024)

Adaptive 3D UI Placement in Mixed Reality Using Deep Reinforcement Learning
by: Lu, Feiyu, et al.
Published: (2025)

Human-Centered Explainability in AI-Enhanced UI Security Interfaces: Designing Trustworthy Copilots for Cybersecurity Analysts
by: Rajhans, Mona
Published: (2026)

ShowUI-$π$: Flow-based Generative Models as GUI Dexterous Hands
by: Hu, Siyuan, et al.
Published: (2025)

Privacy Starts with UI: Privacy Patterns and Designer Perspectives in UI/UX Practice
by: Maloku, Anxhela, et al.
Published: (2026)

Macaron-A2UI: A Model for Generative UI in Personal Agents
by: Kong, Fancy, et al.
Published: (2026)

UI Remix: Supporting UI Design Through Interactive Example Retrieval and Remixing
by: Wang, Junling, et al.
Published: (2026)

MLLM-Based UI2Code Automation Guided by UI Layout Information
by: Wu, Fan, et al.
Published: (2025)

UI-TARS: Pioneering Automated GUI Interaction with Native Agents
by: Qin, Yujia, et al.
Published: (2025)

Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs
by: You, Keen, et al.
Published: (2024)

CrowdGenUI: Aligning LLM-Based UI Generation with Crowdsourced User Preferences
by: Liu, Yimeng, et al.
Published: (2024)

The Imitation Game for Educational AI
by: Sonkar, Shashank, et al.
Published: (2025)

ReDemon UI: Reactive Synthesis by Demonstration for Web UI
by: Lee, Jay, et al.
Published: (2025)

A Platform-Agnostic Multimodal Digital Human Modelling Framework: Neurophysiological Sensing in Game-Based Interaction
by: Buxton, Daniel J., et al.
Published: (2026)

Affordances of Sketched Notations for Multimodal UI Design and Development Tools
by: Ross, Sam H., et al.
Published: (2025)

Predicting and Explaining Mobile UI Tappability with Vision Modeling and Saliency Analysis
by: Schoop, Eldon, et al.
Published: (2022)

SparkUI-Parser: Enhancing GUI Perception with Robust Grounding and Parsing
by: Jing, Hongyi, et al.
Published: (2025)

ReFinE: Streamlining UI Mockup Iteration with Research Findings
by: Shin, Donghoon, et al.
Published: (2026)