Imagen de Portada

UI-Ins: Enhancing GUI Grounding with Multi-Perspective Instruction-as-Reasoning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Chen, Liangyu, Zhou, Hanzhang, Cai, Chenglin, Zhang, Jianan, Tong, Panrong, Kong, Quyu, Zhang, Xu, Liu, Chen, Liu, Yuqi, Wang, Wenxuan, Wang, Yue, Jin, Qin, Hoi, Steven
Formato:	Preprint
Publicado:	2025
Materias:	Computer Vision and Pattern Recognition Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

MAI-UI Technical Report: Real-World Centric Foundation GUI Agents
por: Zhou, Hanzhang, et al.
Publicado: (2025)

MobileWorld: Benchmarking Autonomous Mobile Agents in Agent-User Interactive and MCP-Augmented Environments
por: Kong, Quyu, et al.
Publicado: (2025)

Aria-UI: Visual Grounding for GUI Instructions
por: Yang, Yuhao, et al.
Publicado: (2024)

Byte-token Enhanced Language Models for Temporal Point Processes Analysis
por: Kong, Quyu, et al.
Publicado: (2025)

FedGUI: Benchmarking Federated GUI Agents across Heterogeneous Platforms, Devices, and Operating Systems
por: Wang, Wenhao, et al.
Publicado: (2026)

UI-E2I-Synth: Advancing GUI Grounding with Large-Scale Instruction Synthesis
por: Liu, Xinyi, et al.
Publicado: (2025)

Falcon-UI: Understanding GUI Before Following User Instructions
por: Shen, Huawen, et al.
Publicado: (2024)

BTL-UI: Blink-Think-Link Reasoning Model for GUI Agent
por: Zhang, Shaojie, et al.
Publicado: (2025)

UI-Zoomer: Uncertainty-Driven Adaptive Zoom-In for GUI Grounding
por: Tang, Fei, et al.
Publicado: (2026)

SparkUI-Parser: Enhancing GUI Perception with Robust Grounding and Parsing
por: Jing, Hongyi, et al.
Publicado: (2025)

DiMo-GUI: Advancing Test-time Scaling in GUI Grounding via Modality-Aware Visual Reasoning
por: Wu, Hang, et al.
Publicado: (2025)

UI-TARS: Pioneering Automated GUI Interaction with Native Agents
por: Qin, Yujia, et al.
Publicado: (2025)

ShowUI-Aloha: Human-Taught GUI Agent
por: Zhang, Yichun, et al.
Publicado: (2026)

ChartM$^3$: Benchmarking Chart Editing with Multimodal Instructions
por: Yang, Donglu, et al.
Publicado: (2025)

AdaZoom-GUI: Adaptive Zoom-based GUI Grounding with Instruction Refinement
por: Pei, Siqi, et al.
Publicado: (2026)

Grounding 3D Object Affordance with Language Instructions, Visual Observations and Interactions
por: Zhu, He, et al.
Publicado: (2025)

ChartEditor: A Reinforcement Learning Framework for Robust Chart Editing
por: Chen, Liangyu, et al.
Publicado: (2025)

UI-Oceanus: Scaling GUI Agents with Synthetic Environmental Dynamics
por: Wu, Mengzhou, et al.
Publicado: (2026)

LongIns: A Challenging Long-context Instruction-based Exam for LLMs
por: Gavin, Shawn, et al.
Publicado: (2024)

AQuaUI: Visual Token Reduction for GUI Agents with Adaptive Quadtrees
por: Li, Yuankai, et al.
Publicado: (2026)

UI-AGILE: Advancing GUI Agents with Effective Reinforcement Learning and Precise Inference-Time Grounding
por: Lian, Shuquan, et al.
Publicado: (2025)

GUI-Eyes: Tool-Augmented Perception for Visual Grounding in GUI Agents
por: Chen, Chen, et al.
Publicado: (2026)

DRS-GUI: Dynamic Region Search for Training-Free GUI Grounding
por: Liu, Yichao, et al.
Publicado: (2026)

GUI-Actor: Coordinate-Free Visual Grounding for GUI Agents
por: Wu, Qianhui, et al.
Publicado: (2025)

UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learning
por: Wang, Haoming, et al.
Publicado: (2025)

InsBank: Evolving Instruction Subset for Ongoing Alignment
por: Shi, Jiayi, et al.
Publicado: (2025)

POINTS-GUI-G: GUI-Grounding Journey
por: Zhao, Zhongyin, et al.
Publicado: (2026)

Learning GUI Grounding with Spatial Reasoning from Visual Feedback
por: Zhao, Yu, et al.
Publicado: (2025)

UI-Mem: Self-Evolving Experience Memory for Online Reinforcement Learning in Mobile GUI Agents
por: Xiao, Han, et al.
Publicado: (2026)

InsCL: A Data-efficient Continual Learning Paradigm for Fine-tuning Large Language Models with Instructions
por: Wang, Yifan, et al.
Publicado: (2024)

InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Construction
por: Wu, Yuhui, et al.
Publicado: (2025)

UI-KOBE: Knowledge-Oriented Behavior Exploration for Lightweight Graph-Guided GUI Agents
por: Chai, Yuxiang, et al.
Publicado: (2026)

GUI-G1: Understanding R1-Zero-Like Training for Visual Grounding in GUI Agents
por: Zhou, Yuqi, et al.
Publicado: (2025)

POLYCHARTQA: Benchmarking Large Vision-Language Models with Multilingual Chart Question Answering
por: Xu, Yichen, et al.
Publicado: (2025)

AutoGUI: Scaling GUI Grounding with Automatic Functionality Annotations from LLMs
por: Li, Hongxin, et al.
Publicado: (2025)

Fair Bayesian Data Selection via Generalized Discrepancy Measures
por: Zhang, Yixuan, et al.
Publicado: (2025)

GUI-ARP: Enhancing Grounding with Adaptive Region Perception for GUI Agents
por: Ye, Xianhang, et al.
Publicado: (2025)

GUI-G$^2$: Gaussian Reward Modeling for GUI Grounding
por: Tang, Fei, et al.
Publicado: (2025)

InfiGUI-G1: Advancing GUI Grounding with Adaptive Exploration Policy Optimization
por: Liu, Yuhang, et al.
Publicado: (2025)

Chain-of-Ground: Improving GUI Grounding via Iterative Reasoning and Reference Feedback
por: Li, Aiden Yiliu, et al.
Publicado: (2025)