Copertina

WinClick: GUI Grounding with Multimodal Large Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Hui, Zheng, Li, Yinheng, zhao, Dan, Chen, Tianyi, Banbury, Colby, Koishida, Kazuhito
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language Human-Computer Interaction
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Self-reflecting Large Language Models: A Hegelian Dialectical Approach
di: Abdali, Sara, et al.
Pubblicazione: (2025)

SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents
di: Cheng, Kanzhi, et al.
Pubblicazione: (2024)

Large Language Model-Brained GUI Agents: A Survey
di: Zhang, Chaoyun, et al.
Pubblicazione: (2024)

Grounding Gaps in Language Model Generations
di: Shaikh, Omar, et al.
Pubblicazione: (2023)

SQLucid: Grounding Natural Language Database Queries with Interactive Explanations
di: Tian, Yuan, et al.
Pubblicazione: (2024)

Empathic Grounding: Explorations using Multimodal Interaction and Large Language Models with Conversational Agents
di: Arjmand, Mehdi, et al.
Pubblicazione: (2024)

GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agents
di: Luo, Run, et al.
Pubblicazione: (2025)

GUI-AIMA: Aligning Intrinsic Multimodal Attention with a Context Anchor for GUI Grounding
di: Zhou, Shijie, et al.
Pubblicazione: (2025)

ReactGenie: A Development Framework for Complex Multimodal Interactions Using Large Language Models
di: Yang, Jackie Junrui, et al.
Pubblicazione: (2023)

SparkUI-Parser: Enhancing GUI Perception with Robust Grounding and Parsing
di: Jing, Hongyi, et al.
Pubblicazione: (2025)

Multimodal Programming in Computer Science with Interactive Assistance Powered by Large Language Model
di: Gupta, Rajan Das, et al.
Pubblicazione: (2025)

See, Think, Act: Teaching Multimodal Agents to Effectively Interact with GUI by Identifying Toggles
di: Wu, Zongru, et al.
Pubblicazione: (2025)

UI-E2I-Synth: Advancing GUI Grounding with Large-Scale Instruction Synthesis
di: Liu, Xinyi, et al.
Pubblicazione: (2025)

InfiGUIAgent: A Multimodal Generalist GUI Agent with Native Reasoning and Reflection
di: Liu, Yuhang, et al.
Pubblicazione: (2025)

Are Humans as Brittle as Large Language Models?
di: Li, Jiahui, et al.
Pubblicazione: (2025)

GUI-G$^2$: Gaussian Reward Modeling for GUI Grounding
di: Tang, Fei, et al.
Pubblicazione: (2025)

Beyond Clicking:A Step Towards Generalist GUI Grounding via Text Dragging
di: Liao, Zeyi, et al.
Pubblicazione: (2025)

Visualization Literacy of Multimodal Large Language Models: A Comparative Study
di: Li, Zhimin, et al.
Pubblicazione: (2024)

Dialogue Language Model with Large-Scale Persona Data Engineering
di: Hong, Mengze, et al.
Pubblicazione: (2024)

Large Language Models for Depression Recognition in Spoken Language Integrating Psychological Knowledge
di: Li, Yupei, et al.
Pubblicazione: (2025)

Data Generation Using Large Language Models for Text Classification: An Empirical Case Study
di: Li, Yinheng, et al.
Pubblicazione: (2024)

Towards Valid Student Simulation with Large Language Models
di: Yuan, Zhihao, et al.
Pubblicazione: (2026)

Multimodal Dialog Systems with Dual Knowledge-enhanced Generative Pretrained Language Model
di: Chen, Xiaolin, et al.
Pubblicazione: (2022)

Large Language Model-based Human-Agent Collaboration for Complex Task Solving
di: Feng, Xueyang, et al.
Pubblicazione: (2024)

VisEval: A Benchmark for Data Visualization in the Era of Large Language Models
di: Chen, Nan, et al.
Pubblicazione: (2024)

Large Language Models Pass the Turing Test
di: Jones, Cameron R., et al.
Pubblicazione: (2025)

Social Skill Training with Large Language Models
di: Yang, Diyi, et al.
Pubblicazione: (2024)

A Systematic Review on Prompt Engineering in Large Language Models for K-12 STEM Education
di: Chen, Eason, et al.
Pubblicazione: (2024)

"Harmless to You, Hurtful to Me!": Investigating the Detection of Toxic Languages Grounded in the Perspective of Youth
di: Li, Yaqiong, et al.
Pubblicazione: (2025)

Leveraging Large Language Models for Identifying Knowledge Components
di: Wang, Canwen, et al.
Pubblicazione: (2025)

Large Language Models for Virtual Human Gesture Selection
di: Torshizi, Parisa Ghanad, et al.
Pubblicazione: (2025)

An Actor-Critic Approach to Boosting Text-to-SQL Large Language Model
di: Zheng, Ziyang, et al.
Pubblicazione: (2024)

Will the Real Linda Please Stand up...to Large Language Models? Examining the Representativeness Heuristic in LLMs
di: Wang, Pengda, et al.
Pubblicazione: (2024)

Beyond Chat and Clicks: GUI Agents for In-Situ Assistance via Live Interface Transformation
di: Hao, Pan, et al.
Pubblicazione: (2026)

Smoothing Grounding and Reasoning for MLLM-Powered GUI Agents with Query-Oriented Pivot Tasks
di: Wu, Zongru, et al.
Pubblicazione: (2025)

AutoTutor meets Large Language Models: A Language Model Tutor with Rich Pedagogy and Guardrails
di: Chowdhury, Sankalan Pal, et al.
Pubblicazione: (2024)

Empowering Private Tutoring by Chaining Large Language Models
di: Chen, Yulin, et al.
Pubblicazione: (2023)

Large Language Models Help Humans Verify Truthfulness -- Except When They Are Convincingly Wrong
di: Si, Chenglei, et al.
Pubblicazione: (2023)

ShowUI: One Vision-Language-Action Model for GUI Visual Agent
di: Lin, Kevin Qinghong, et al.
Pubblicazione: (2024)

Leveraging Large Language Models for Learning Complex Legal Concepts through Storytelling
di: Jiang, Hang, et al.
Pubblicazione: (2024)