Image de couverture de livre

DrawingBench: Evaluating Spatial Reasoning and UI Interaction Capabilities of Large Language Models through Mouse-Based Drawing Tasks

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Kim, Hyunjun, Ryu, Sooyoung
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

LTD-Bench: Evaluating Large Language Models by Letting Them Draw
par: Lin, Liuhao, et autres
Publié: (2025)

MacroBench: A Novel Testbed for Web Automation Scripts via Large Language Models
par: Kim, Hyunjun, et autres
Publié: (2025)

Draw2Think: Harnessing Geometry Reasoning through Constraint Engine Interaction
par: Hu, Juncheng, et autres
Publié: (2026)

Drawing Conclusions from Draws: Rethinking Preference Semantics in Arena-Style LLM Evaluation
par: Tang, Raphael, et autres
Publié: (2025)

CityBench: Evaluating the Capabilities of Large Language Models for Urban Tasks
par: Feng, Jie, et autres
Publié: (2024)

UI-Bench: A Benchmark for Evaluating Design Capabilities of AI Text-to-App Tools
par: Jung, Sam, et autres
Publié: (2025)

Reasoning Capabilities of Large Language Models on Dynamic Tasks
par: Wong, Annie, et autres
Publié: (2025)

Constructing a Norm for Children's Scientific Drawing: Distribution Features Based on Semantic Similarity of Large Language Models
par: Zhang, Yi, et autres
Publié: (2025)

Evaluating Accounting Reasoning Capabilities of Large Language Models
par: Zhou, Jie, et autres
Publié: (2026)

Draw with Thought: Unleashing Multimodal Reasoning for Scientific Diagram Generation
par: Cui, Zhiqing, et autres
Publié: (2025)

RefineBench: Evaluating Refinement Capability of Language Models via Checklists
par: Lee, Young-Jun, et autres
Publié: (2025)

HelloBench: Evaluating Long Text Generation Capabilities of Large Language Models
par: Que, Haoran, et autres
Publié: (2024)

RAD-Bench: Evaluating Large Language Models Capabilities in Retrieval Augmented Dialogues
par: Kuo, Tzu-Lin, et autres
Publié: (2024)

DebugBench: Evaluating Debugging Capability of Large Language Models
par: Tian, Runchu, et autres
Publié: (2024)

MentalBench: A DSM-Grounded Benchmark for Evaluating Psychiatric Diagnostic Capability of Large Language Models
par: Song, Hoyun, et autres
Publié: (2026)

Evaluating Consistency and Reasoning Capabilities of Large Language Models
par: Saxena, Yash, et autres
Publié: (2024)

LR^2Bench: Evaluating Long-chain Reflective Reasoning Capabilities of Large Language Models via Constraint Satisfaction Problems
par: Chen, Jianghao, et autres
Publié: (2025)

FoundaBench: Evaluating Chinese Fundamental Knowledge Capabilities of Large Language Models
par: Li, Wei, et autres
Publié: (2024)

DrawEduMath: Evaluating Vision Language Models with Expert-Annotated Students' Hand-Drawn Math Images
par: Baral, Sami, et autres
Publié: (2025)

CounterBench: Evaluating and Improving Counterfactual Reasoning in Large Language Models
par: Chen, Yuefei, et autres
Publié: (2025)

Towards an Analysis of Discourse and Interactional Pragmatic Reasoning Capabilities of Large Language Models
par: Robrecht, Amelie, et autres
Publié: (2024)

Defensive M2S: Training Guardrail Models on Compressed Multi-turn Conversations
par: Kim, Hyunjun
Publié: (2026)

OralMLLM-Bench: Evaluating Cognitive Capabilities of Multimodal Large Language Models in Dental Practice
par: Wang, Rongyang, et autres
Publié: (2026)

Entropic Context Shaping: Information-Theoretic Filtering for Context-Aware LLM Agents
par: Kim, Hyunjun
Publié: (2026)

Reasoning Capabilities and Invariability of Large Language Models
par: Raganato, Alessandro, et autres
Publié: (2025)

Evaluating the Formal Reasoning Capabilities of Large Language Models through Chomsky Hierarchy
par: Dong, Yihong, et autres
Publié: (2026)

Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks
par: Wu, Zhaofeng, et autres
Publié: (2023)

RedacBench: Can AI Erase Your Secrets?
par: Jeon, Hyunjun, et autres
Publié: (2026)

Relative Drawing Identification Complexity is Invariant to Modality in Vision-Language Models
par: Freitas, Diogo, et autres
Publié: (2025)

Evaluating the Capability of Large-scale Language Models on Chinese Grammatical Error Correction Task
par: Qu, Fanyi, et autres
Publié: (2023)

Evaluating Interventional Reasoning Capabilities of Large Language Models
par: Kasetty, Tejas, et autres
Publié: (2024)

EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Models
par: Du, Mengfei, et autres
Publié: (2024)

Evaluating Large Language Models on Spatial Tasks: A Multi-Task Benchmarking Study
par: Xu, Liuchang, et autres
Publié: (2024)

The Aftermath of DrawEduMath: Vision Language Models Underperform with Struggling Students and Misdiagnose Errors
par: Lucy, Li, et autres
Publié: (2026)

EffiReason-Bench: A Unified Benchmark for Evaluating and Advancing Efficient Reasoning in Large Language Models
par: Huang, Junquan, et autres
Publié: (2025)

Evaluating the Generalization Capabilities of Large Language Models on Code Reasoning
par: Yang, Rem, et autres
Publié: (2025)

TaskBench: Benchmarking Large Language Models for Task Automation
par: Shen, Yongliang, et autres
Publié: (2023)

Marco-Bench-MIF: On Multilingual Instruction-Following Capability of Large Language Models
par: Zeng, Bo, et autres
Publié: (2025)

Draw Your Mind: Personalized Generation via Condition-Level Modeling in Text-to-Image Diffusion Models
par: Kim, Hyungjin, et autres
Publié: (2025)

SimulBench: Evaluating Language Models with Creative Simulation Tasks
par: Jia, Qi, et autres
Publié: (2024)