GUI-ReRank: Enhancing GUI Retrieval with Multi-Modal LLM-based Reranking
Fuente:
arXiv
Saved in:
| Main Authors: | Kolthoff, Kristian, Kretzer, Felix, Bartelt, Christian, Maedche, Alexander, Ponzetto, Simone Paolo |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
GUIDE: LLM-Driven GUI Generation Decomposition for Automated Prototyping
by: Kolthoff, Kristian, et al.
Published: (2025)
by: Kolthoff, Kristian, et al.
Published: (2025)
Interlinking User Stories and GUI Prototyping: A Semi-Automatic LLM-based Approach
by: Kolthoff, Kristian, et al.
Published: (2024)
by: Kolthoff, Kristian, et al.
Published: (2024)
GUISpector: An MLLM Agent Framework for Automated Verification of Natural Language Requirements in GUI Prototypes
by: Kolthoff, Kristian, et al.
Published: (2025)
by: Kolthoff, Kristian, et al.
Published: (2025)
Zero-Shot Prompting Approaches for LLM-based Graphical User Interface Generation
by: Kolthoff, Kristian, et al.
Published: (2024)
by: Kolthoff, Kristian, et al.
Published: (2024)
Self-Elicitation of Requirements with Automated GUI Prototyping
by: Kolthoff, Kristian, et al.
Published: (2024)
by: Kolthoff, Kristian, et al.
Published: (2024)
Scenario-Guided LLM-based Mobile App GUI Testing
by: Yu, Shengcheng, et al.
Published: (2025)
by: Yu, Shengcheng, et al.
Published: (2025)
PlayCoder: Making LLM-Generated GUI Code Playable
by: Peng, Zhiyuan, et al.
Published: (2026)
by: Peng, Zhiyuan, et al.
Published: (2026)
Temac: Multi-Agent Collaboration for Automated Web GUI Testing
by: Liu, Chenxu, et al.
Published: (2025)
by: Liu, Chenxu, et al.
Published: (2025)
Gamified GUI testing with Selenium in the IntelliJ IDE: A Prototype Plugin
by: Garaccione, Giacomo, et al.
Published: (2024)
by: Garaccione, Giacomo, et al.
Published: (2024)
Qualitative Evaluation of LLM-Designed GUI
by: Sawicki, Bartosz, et al.
Published: (2026)
by: Sawicki, Bartosz, et al.
Published: (2026)
Proactive Detection of GUI Defects in Multi-Window Scenarios via Multimodal Reasoning
by: Zhang, Xinyao, et al.
Published: (2026)
by: Zhang, Xinyao, et al.
Published: (2026)
Deep Reinforcement Learning for Automated Web GUI Testing
by: Gu, Zhiyu, et al.
Published: (2025)
by: Gu, Zhiyu, et al.
Published: (2025)
Screencast-Based Analysis of User-Perceived GUI Responsiveness
by: Liu, Wei, et al.
Published: (2025)
by: Liu, Wei, et al.
Published: (2025)
AccessFixer: Enhancing GUI Accessibility for Low Vision Users With R-GCN Model
by: Zhang, Mengxi, et al.
Published: (2025)
by: Zhang, Mengxi, et al.
Published: (2025)
Automated Testing of the GUI of a Real-Life Engineering Software using Large Language Models
by: Rosenbach, Tim, et al.
Published: (2025)
by: Rosenbach, Tim, et al.
Published: (2025)
Vision-Based Mobile App GUI Testing: A Survey
by: Yu, Shengcheng, et al.
Published: (2023)
by: Yu, Shengcheng, et al.
Published: (2023)
AUITestAgent: Automatic Requirements Oriented GUI Function Testing
by: Hu, Yongxiang, et al.
Published: (2024)
by: Hu, Yongxiang, et al.
Published: (2024)
GUIPilot: A Consistency-based Mobile GUI Testing Approach for Detecting Application-specific Bugs
by: Liu, Ruofan, et al.
Published: (2025)
by: Liu, Ruofan, et al.
Published: (2025)
GUIWatcher: Automatically Detecting GUI Lags by Analyzing Mobile Application Screencasts
by: Liu, Wei, et al.
Published: (2025)
by: Liu, Wei, et al.
Published: (2025)
GUI Test Migration via Abstraction and Concretization
by: Zhang, Yakun, et al.
Published: (2024)
by: Zhang, Yakun, et al.
Published: (2024)
Enhancing GUI Exploration Coverage of Android Apps with Deep Link-Integrated Monkey
by: Hu, Han, et al.
Published: (2024)
by: Hu, Han, et al.
Published: (2024)
VLAA-GUI: Knowing When to Stop, Recover, and Search, A Modular Framework for GUI Automation
by: Han, Qijun, et al.
Published: (2026)
by: Han, Qijun, et al.
Published: (2026)
Effective, Platform-Independent GUI Testing via Image Embedding and Reinforcement Learning
by: Yu, Shengcheng, et al.
Published: (2022)
by: Yu, Shengcheng, et al.
Published: (2022)
Large Language Models for Mobile GUI Text Input Generation: An Empirical Study
by: Cui, Chenhui, et al.
Published: (2024)
by: Cui, Chenhui, et al.
Published: (2024)
Leveraging Large Vision Language Model For Better Automatic Web GUI Testing
by: Wang, Siyi, et al.
Published: (2024)
by: Wang, Siyi, et al.
Published: (2024)
From Task to Tutorial: An Automated GUI Framework for Excel Tutorial Document and Video Creation
by: Xie, Yuhang, et al.
Published: (2025)
by: Xie, Yuhang, et al.
Published: (2025)
Don't Confuse! Redrawing GUI Navigation Flow in Mobile Apps for Visually Impaired Users
by: Zhang, Mengxi, et al.
Published: (2025)
by: Zhang, Mengxi, et al.
Published: (2025)
Test Script Intention Generation for Mobile Application via GUI Image and Code Understanding
by: Yu, Shengcheng, et al.
Published: (2021)
by: Yu, Shengcheng, et al.
Published: (2021)
FuncDroid: Towards Inter-Functional Flows for Comprehensive Mobile App GUI Testing
by: He, Jinlong, et al.
Published: (2026)
by: He, Jinlong, et al.
Published: (2026)
Semantic GUI Scene Learning and Video Alignment for Detecting Duplicate Video-based Bug Reports
by: Yan, Yanfu, et al.
Published: (2024)
by: Yan, Yanfu, et al.
Published: (2024)
GUITestScape: Towards Open-set Evaluation on Exploratory GUI Testing
by: Chen, Xiaoyi, et al.
Published: (2026)
by: Chen, Xiaoyi, et al.
Published: (2026)
InfraMind: A Novel Exploration-based GUI Agentic Framework for Mission-critical Industrial Management
by: Lin, Liangtao, et al.
Published: (2025)
by: Lin, Liangtao, et al.
Published: (2025)
PopSweeper: Automatically Detecting and Resolving App-Blocking Pop-Ups to Assist Automated Mobile GUI Testing
by: Guo, Linqiang, et al.
Published: (2024)
by: Guo, Linqiang, et al.
Published: (2024)
DiagEval: Trajectory-Conditioned Diagnosis for Reliable Software Evaluation with GUI Agents
by: Hong, Sirui, et al.
Published: (2026)
by: Hong, Sirui, et al.
Published: (2026)
ViMoTest: A Tool to Specify ViewModel-Based GUI Test Scenarios using Projectional Editing
by: Fuksa, Mario, et al.
Published: (2025)
by: Fuksa, Mario, et al.
Published: (2025)
Responsive Graphical User Interface (ReGUI) and its Implementation in MATLAB
by: Mikulszky, Matej, et al.
Published: (2017)
by: Mikulszky, Matej, et al.
Published: (2017)
AndroidControl-Curated: Revealing the True Potential of GUI Agents through Benchmark Purification
by: Leung, Ho Fai, et al.
Published: (2025)
by: Leung, Ho Fai, et al.
Published: (2025)
Fragmented Layer Grouping in GUI Designs Through Graph Learning Based on Multimodal Information
by: Chen, Yunnong, et al.
Published: (2024)
by: Chen, Yunnong, et al.
Published: (2024)
SafeGround: Know When to Trust GUI Grounding Models via Uncertainty Calibration
by: Wang, Qingni, et al.
Published: (2026)
by: Wang, Qingni, et al.
Published: (2026)
FRIENDS GUI: A graphical user interface for data collection and visualization of vaping behavior from a passive vaping monitor
by: Pranto, Shehan Irteza, et al.
Published: (2025)
by: Pranto, Shehan Irteza, et al.
Published: (2025)
Similar Items
-
GUIDE: LLM-Driven GUI Generation Decomposition for Automated Prototyping
by: Kolthoff, Kristian, et al.
Published: (2025) -
Interlinking User Stories and GUI Prototyping: A Semi-Automatic LLM-based Approach
by: Kolthoff, Kristian, et al.
Published: (2024) -
GUISpector: An MLLM Agent Framework for Automated Verification of Natural Language Requirements in GUI Prototypes
by: Kolthoff, Kristian, et al.
Published: (2025) -
Zero-Shot Prompting Approaches for LLM-based Graphical User Interface Generation
by: Kolthoff, Kristian, et al.
Published: (2024) -
Self-Elicitation of Requirements with Automated GUI Prototyping
by: Kolthoff, Kristian, et al.
Published: (2024)