Cover Image

Fragmented Layer Grouping in GUI Designs Through Graph Learning Based on Multimodal Information

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Yunnong, Xiao, Shuhong, Li, Jiazhi, Zhou, Tingting, Chang, Yanfang, Zhen, Yankun, Sun, Lingyun, Chen, Liuqing
Format:	Preprint
Published:	2024
Subjects:	Software Engineering Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

UI Semantic Group Detection: Grouping UI Elements with Similar Semantics in Mobile Graphical User Interface
by: Xiao, Shuhong, et al.
Published: (2024)

Prototype2Code: End-to-end Front-end Code Generation from UI Design Prototypes
by: Xiao, Shuhong, et al.
Published: (2024)

DesignCoder: Hierarchy-Aware and Self-Correcting UI Code Generation with Large Language Models
by: Chen, Yunnong, et al.
Published: (2025)

An Artificial Intelligence Approach for Interpreting Creative Combinational Designs
by: Chen, Liuqing, et al.
Published: (2024)

Scenario-Guided LLM-based Mobile App GUI Testing
by: Yu, Shengcheng, et al.
Published: (2025)

MindScratch: A Visual Programming Support Tool for Classroom Learning Based on Multimodal Generative AI
by: Chen, Yunnong, et al.
Published: (2024)

AUITestAgent: Automatic Requirements Oriented GUI Function Testing
by: Hu, Yongxiang, et al.
Published: (2024)

Deep Reinforcement Learning for Automated Web GUI Testing
by: Gu, Zhiyu, et al.
Published: (2025)

Proactive Detection of GUI Defects in Multi-Window Scenarios via Multimodal Reasoning
by: Zhang, Xinyao, et al.
Published: (2026)

Vision-Based Mobile App GUI Testing: A Survey
by: Yu, Shengcheng, et al.
Published: (2023)

Don't Confuse! Redrawing GUI Navigation Flow in Mobile Apps for Visually Impaired Users
by: Zhang, Mengxi, et al.
Published: (2025)

Enhancing GUI Exploration Coverage of Android Apps with Deep Link-Integrated Monkey
by: Hu, Han, et al.
Published: (2024)

Screencast-Based Analysis of User-Perceived GUI Responsiveness
by: Liu, Wei, et al.
Published: (2025)

GUI-ReRank: Enhancing GUI Retrieval with Multi-Modal LLM-based Reranking
by: Kolthoff, Kristian, et al.
Published: (2025)

From UI to Code: Mobile Ads Detection via LLM-Unified Static-Dynamic Analysis
by: Ma, Shang, et al.
Published: (2026)

GUIWatcher: Automatically Detecting GUI Lags by Analyzing Mobile Application Screencasts
by: Liu, Wei, et al.
Published: (2025)

Test Script Intention Generation for Mobile Application via GUI Image and Code Understanding
by: Yu, Shengcheng, et al.
Published: (2021)

Effective, Platform-Independent GUI Testing via Image Embedding and Reinforcement Learning
by: Yu, Shengcheng, et al.
Published: (2022)

Large Language Models for Mobile GUI Text Input Generation: An Empirical Study
by: Cui, Chenhui, et al.
Published: (2024)

AccessFixer: Enhancing GUI Accessibility for Low Vision Users With R-GCN Model
by: Zhang, Mengxi, et al.
Published: (2025)

PSD2Code: Automated Front-End Code Generation from Design Files via Multimodal Large Language Models
by: Chen, Yongxi, et al.
Published: (2025)

Figma2Code: Automating Multimodal Design to Code in the Wild
by: Gui, Yi, et al.
Published: (2026)

Towards Better Graph Neural Network-based Fault Localization Through Enhanced Code Representation
by: Rafi, Md Nakhla, et al.
Published: (2024)

Context-Sensitive Pointer Analysis for ArkTS
by: Yang, Yizhuo, et al.
Published: (2026)

ArkAnalyzer: The Static Analysis Framework for OpenHarmony
by: Chen, Haonan, et al.
Published: (2025)

Self-Elicitation of Requirements with Automated GUI Prototyping
by: Kolthoff, Kristian, et al.
Published: (2024)

GUIPilot: A Consistency-based Mobile GUI Testing Approach for Detecting Application-specific Bugs
by: Liu, Ruofan, et al.
Published: (2025)

PopSweeper: Automatically Detecting and Resolving App-Blocking Pop-Ups to Assist Automated Mobile GUI Testing
by: Guo, Linqiang, et al.
Published: (2024)

GUI Test Migration via Abstraction and Concretization
by: Zhang, Yakun, et al.
Published: (2024)

From Task to Tutorial: An Automated GUI Framework for Excel Tutorial Document and Video Creation
by: Xie, Yuhang, et al.
Published: (2025)

Bridging Design and Development with Automated Declarative UI Code Generation
by: Zhou, Ting, et al.
Published: (2024)

ChatScratch: An AI-Augmented System Toward Autonomous Visual Programming Learning for Children Aged 6-12
by: Chen, Liuqing, et al.
Published: (2024)

Temac: Multi-Agent Collaboration for Automated Web GUI Testing
by: Liu, Chenxu, et al.
Published: (2025)

GUIDE: LLM-Driven GUI Generation Decomposition for Automated Prototyping
by: Kolthoff, Kristian, et al.
Published: (2025)

PlayCoder: Making LLM-Generated GUI Code Playable
by: Peng, Zhiyuan, et al.
Published: (2026)

Identifying Concurrency Bug Reports via Linguistic Patterns
by: Shao, Shuai, et al.
Published: (2026)

UICopilot: Automating UI Synthesis via Hierarchical Code Generation from Webpage Designs
by: Gui, Yi, et al.
Published: (2025)

Qualitative Evaluation of LLM-Designed GUI
by: Sawicki, Bartosz, et al.
Published: (2026)

GUITestScape: Towards Open-set Evaluation on Exploratory GUI Testing
by: Chen, Xiaoyi, et al.
Published: (2026)

Zero-Permission Manipulation: Can We Trust Large Multimodal Model Powered GUI Agents?
by: Qian, Yi, et al.
Published: (2026)