Image de couverture de livre

UI-Ins: Enhancing GUI Grounding with Multi-Perspective Instruction-as-Reasoning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Chen, Liangyu, Zhou, Hanzhang, Cai, Chenglin, Zhang, Jianan, Tong, Panrong, Kong, Quyu, Zhang, Xu, Liu, Chen, Liu, Yuqi, Wang, Wenxuan, Wang, Yue, Jin, Qin, Hoi, Steven
Format:	Preprint
Publié:	2025
Sujets:	Computer Vision and Pattern Recognition Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

MAI-UI Technical Report: Real-World Centric Foundation GUI Agents
par: Zhou, Hanzhang, et autres
Publié: (2025)

MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments
par: Kong, Quyu, et autres
Publié: (2025)

Aria-UI: Visual Grounding for GUI Instructions
par: Yang, Yuhao, et autres
Publié: (2024)

Byte-token Enhanced Language Models for Temporal Point Processes Analysis
par: Kong, Quyu, et autres
Publié: (2025)

FedGUI: Benchmarking Federated GUI Agents across Heterogeneous Platforms, Devices, and Operating Systems
par: Wang, Wenhao, et autres
Publié: (2026)

UI-E2I-Synth: Advancing GUI Grounding with Large-Scale Instruction Synthesis
par: Liu, Xinyi, et autres
Publié: (2025)

Falcon-UI: Understanding GUI Before Following User Instructions
par: Shen, Huawen, et autres
Publié: (2024)

BTL-UI: Blink-Think-Link Reasoning Model for GUI Agent
par: Zhang, Shaojie, et autres
Publié: (2025)

UI-Zoomer: Uncertainty-Driven Adaptive Zoom-In for GUI Grounding
par: Tang, Fei, et autres
Publié: (2026)

SparkUI-Parser: Enhancing GUI Perception with Robust Grounding and Parsing
par: Jing, Hongyi, et autres
Publié: (2025)

DiMo-GUI: Advancing Test-time Scaling in GUI Grounding via Modality-Aware Visual Reasoning
par: Wu, Hang, et autres
Publié: (2025)

UI-TARS: Pioneering Automated GUI Interaction with Native Agents
par: Qin, Yujia, et autres
Publié: (2025)

ShowUI-Aloha: Human-Taught GUI Agent
par: Zhang, Yichun, et autres
Publié: (2026)

ChartM$^3$: Benchmarking Chart Editing with Multimodal Instructions
par: Yang, Donglu, et autres
Publié: (2025)

AdaZoom-GUI: Adaptive Zoom-based GUI Grounding with Instruction Refinement
par: Pei, Siqi, et autres
Publié: (2026)

Grounding 3D Object Affordance with Language Instructions, Visual Observations and Interactions
par: Zhu, He, et autres
Publié: (2025)

ChartEditor: A Reinforcement Learning Framework for Robust Chart Editing
par: Chen, Liangyu, et autres
Publié: (2025)

UI-Oceanus: Scaling GUI Agents with Synthetic Environmental Dynamics
par: Wu, Mengzhou, et autres
Publié: (2026)

LongIns: A Challenging Long-context Instruction-based Exam for LLMs
par: Gavin, Shawn, et autres
Publié: (2024)

AQuaUI: Visual Token Reduction for GUI Agents with Adaptive Quadtrees
par: Li, Yuankai, et autres
Publié: (2026)

UI-AGILE: Advancing GUI Agents with Effective Reinforcement Learning and Precise Inference-Time Grounding
par: Lian, Shuquan, et autres
Publié: (2025)

GUI-Eyes: Tool-Augmented Perception for Visual Grounding in GUI Agents
par: Chen, Chen, et autres
Publié: (2026)

DRS-GUI: Dynamic Region Search for Training-Free GUI Grounding
par: Liu, Yichao, et autres
Publié: (2026)

GUI-Actor: Coordinate-Free Visual Grounding for GUI Agents
par: Wu, Qianhui, et autres
Publié: (2025)

UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning
par: Wang, Haoming, et autres
Publié: (2025)

InsBank: Evolving Instruction Subset for Ongoing Alignment
par: Shi, Jiayi, et autres
Publié: (2025)

POINTS-GUI-G: GUI-Grounding Journey
par: Zhao, Zhongyin, et autres
Publié: (2026)

Learning GUI Grounding with Spatial Reasoning from Visual Feedback
par: Zhao, Yu, et autres
Publié: (2025)

UI-Mem: Self-Evolving Experience Memory for Online Reinforcement Learning in Mobile GUI Agents
par: Xiao, Han, et autres
Publié: (2026)

InsCL: A Data-efficient Continual Learning Paradigm for Fine-tuning Large Language Models with Instructions
par: Wang, Yifan, et autres
Publié: (2024)

InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Construction
par: Wu, Yuhui, et autres
Publié: (2025)

UI-KOBE: Knowledge-Oriented Behavior Exploration for Lightweight Graph-Guided GUI Agents
par: Chai, Yuxiang, et autres
Publié: (2026)

GUI-G1: Understanding R1-Zero-Like Training for Visual Grounding in GUI Agents
par: Zhou, Yuqi, et autres
Publié: (2025)

POLYCHARTQA: Benchmarking Large Vision-Language Models with Multilingual Chart Question Answering
par: Xu, Yichen, et autres
Publié: (2025)

AutoGUI: Scaling GUI Grounding with Automatic Functionality Annotations from LLMs
par: Li, Hongxin, et autres
Publié: (2025)

Fair Bayesian Data Selection via Generalized Discrepancy Measures
par: Zhang, Yixuan, et autres
Publié: (2025)

GUI-ARP: Enhancing Grounding with Adaptive Region Perception for GUI Agents
par: Ye, Xianhang, et autres
Publié: (2025)

GUI-G$^2$: Gaussian Reward Modeling for GUI Grounding
par: Tang, Fei, et autres
Publié: (2025)

InfiGUI-G1: Advancing GUI Grounding with Adaptive Exploration Policy Optimization
par: Liu, Yuhang, et autres
Publié: (2025)

Chain-of-Ground: Improving GUI Grounding via Iterative Reasoning and Reference Feedback
par: Li, Aiden Yiliu, et autres
Publié: (2025)