DesignProbe: A Graphic Design Benchmark for Multimodal Large Language Models
Fuente:
arXiv
Saved in:
| Main Authors: | Lin, Jieru, Huang, Danqing, Zhao, Tiejun, Zhan, Dechen, Lin, Chin-Yew |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Spot the Error: Non-autoregressive Graphic Layout Generation with Wireframe Locator
by: Lin, Jieru, et al.
Published: (2024)
by: Lin, Jieru, et al.
Published: (2024)
From Elements to Design: A Layered Approach for Automatic Graphic Design Composition
by: Lin, Jiawei, et al.
Published: (2024)
by: Lin, Jiawei, et al.
Published: (2024)
Can Vision Language Models Assess Graphic Design Aesthetics? A Benchmark, Evaluation, and Dataset Perspective
by: An, Arctanx, et al.
Published: (2026)
by: An, Arctanx, et al.
Published: (2026)
Desigen: A Pipeline for Controllable Design Template Generation
by: Weng, Haohan, et al.
Published: (2024)
by: Weng, Haohan, et al.
Published: (2024)
Graphic Design with Large Multimodal Model
by: Cheng, Yutao, et al.
Published: (2024)
by: Cheng, Yutao, et al.
Published: (2024)
ReLayout: Versatile and Structure-Preserving Design Layout Editing via Relation-Aware Design Reconstruction
by: Lin, Jiawei, et al.
Published: (2026)
by: Lin, Jiawei, et al.
Published: (2026)
IGD: Instructional Graphic Design with Multimodal Layer Generation
by: Qu, Yadong, et al.
Published: (2025)
by: Qu, Yadong, et al.
Published: (2025)
UTDesign: A Unified Framework for Stylized Text Editing and Generation in Graphic Design Images
by: Zhao, Yiming, et al.
Published: (2025)
by: Zhao, Yiming, et al.
Published: (2025)
Robobench: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models as Embodied Brain
by: Luo, Yulin, et al.
Published: (2025)
by: Luo, Yulin, et al.
Published: (2025)
Multimodal Markup Document Models for Graphic Design Completion
by: Kikuchi, Kotaro, et al.
Published: (2024)
by: Kikuchi, Kotaro, et al.
Published: (2024)
Beyond the Visible: Benchmarking Occlusion Perception in Multimodal Large Language Models
by: Liu, Zhaochen, et al.
Published: (2025)
by: Liu, Zhaochen, et al.
Published: (2025)
Graphic-Design-Bench: A Comprehensive Benchmark for Evaluating AI on Graphic Design Tasks
by: Deganutti, Adrienne, et al.
Published: (2026)
by: Deganutti, Adrienne, et al.
Published: (2026)
SWITCH: Benchmarking Modeling and Handling of Tangible Interfaces in Long-horizon Embodied Scenarios
by: Lin, Jieru, et al.
Published: (2025)
by: Lin, Jieru, et al.
Published: (2025)
DesignAsCode: Bridging Structural Editability and Visual Fidelity in Graphic Design Generation
by: Liu, Ziyuan, et al.
Published: (2026)
by: Liu, Ziyuan, et al.
Published: (2026)
MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models
by: Fu, Chaoyou, et al.
Published: (2023)
by: Fu, Chaoyou, et al.
Published: (2023)
UniSVG: A Unified Dataset for Vector Graphic Understanding and Generation with Multimodal Large Language Models
by: Li, Jinke, et al.
Published: (2025)
by: Li, Jinke, et al.
Published: (2025)
Improving Visual Storytelling with Multimodal Large Language Models
by: Lin, Xiaochuan, et al.
Published: (2024)
by: Lin, Xiaochuan, et al.
Published: (2024)
From Perception to Reasoning: Deep Thinking Empowers Multimodal Large Language Models
by: Zhu, Wenxin, et al.
Published: (2025)
by: Zhu, Wenxin, et al.
Published: (2025)
Valley2: Exploring Multimodal Models with Scalable Vision-Language Design
by: Wu, Ziheng, et al.
Published: (2025)
by: Wu, Ziheng, et al.
Published: (2025)
CreatiDesign: A Unified Multi-Conditional Diffusion Transformer for Creative Graphic Design
by: Zhang, Hui, et al.
Published: (2025)
by: Zhang, Hui, et al.
Published: (2025)
AesBench: An Expert Benchmark for Multimodal Large Language Models on Image Aesthetics Perception
by: Huang, Yipo, et al.
Published: (2024)
by: Huang, Yipo, et al.
Published: (2024)
MFC-Bench: Benchmarking Multimodal Fact-Checking with Large Vision-Language Models
by: Wang, Shengkang, et al.
Published: (2024)
by: Wang, Shengkang, et al.
Published: (2024)
SportR: A Benchmark for Multimodal Large Language Model Reasoning in Sports
by: Xia, Haotian, et al.
Published: (2025)
by: Xia, Haotian, et al.
Published: (2025)
Intelligent Power Grid Design Review via Active Perception-Enabled Multimodal Large Language Models
by: Tan, Taoliang, et al.
Published: (2025)
by: Tan, Taoliang, et al.
Published: (2025)
Semantic Alignment for Multimodal Large Language Models
by: Wu, Tao, et al.
Published: (2024)
by: Wu, Tao, et al.
Published: (2024)
LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Models
by: Ye, Junyan, et al.
Published: (2024)
by: Ye, Junyan, et al.
Published: (2024)
AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Models
by: Patnaik, Sohan, et al.
Published: (2025)
by: Patnaik, Sohan, et al.
Published: (2025)
NavBench: Probing Multimodal Large Language Models for Embodied Navigation
by: Qiao, Yanyuan, et al.
Published: (2025)
by: Qiao, Yanyuan, et al.
Published: (2025)
M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Models
by: Bai, Fan, et al.
Published: (2024)
by: Bai, Fan, et al.
Published: (2024)
SmartHome-Bench: A Comprehensive Benchmark for Video Anomaly Detection in Smart Homes Using Multi-Modal Large Language Models
by: Zhao, Xinyi, et al.
Published: (2025)
by: Zhao, Xinyi, et al.
Published: (2025)
Symbolic Graphics Programming with Large Language Models
by: Chen, Yamei, et al.
Published: (2025)
by: Chen, Yamei, et al.
Published: (2025)
Predicting Visual Attention in Graphic Design Documents
by: Chakraborty, Souradeep, et al.
Published: (2024)
by: Chakraborty, Souradeep, et al.
Published: (2024)
ViRectify: A Challenging Benchmark for Video Reasoning Correction with Multimodal Large Language Models
by: Hei, Xusen, et al.
Published: (2025)
by: Hei, Xusen, et al.
Published: (2025)
PSDesigner: Automated Graphic Design with a Human-Like Creative Workflow
by: Shuai, Xincheng, et al.
Published: (2026)
by: Shuai, Xincheng, et al.
Published: (2026)
Speculative Decoding Reimagined for Multimodal Large Language Models
by: Lin, Luxi, et al.
Published: (2025)
by: Lin, Luxi, et al.
Published: (2025)
PEBench: A Fictitious Dataset to Benchmark Machine Unlearning for Multimodal Large Language Models
by: Xu, Zhaopan, et al.
Published: (2025)
by: Xu, Zhaopan, et al.
Published: (2025)
MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI
by: Ying, Kaining, et al.
Published: (2024)
by: Ying, Kaining, et al.
Published: (2024)
Benchmarking Large Language Models for Image Classification of Marine Mammals
by: Qi, Yijiashun, et al.
Published: (2024)
by: Qi, Yijiashun, et al.
Published: (2024)
Rethinking Facial Expression Recognition in the Era of Multimodal Large Language Models: Benchmark, Datasets, and Beyond
by: Zhang, Fan, et al.
Published: (2025)
by: Zhang, Fan, et al.
Published: (2025)
Can GPTs Evaluate Graphic Design Based on Design Principles?
by: Haraguchi, Daichi, et al.
Published: (2024)
by: Haraguchi, Daichi, et al.
Published: (2024)
Similar Items
-
Spot the Error: Non-autoregressive Graphic Layout Generation with Wireframe Locator
by: Lin, Jieru, et al.
Published: (2024) -
From Elements to Design: A Layered Approach for Automatic Graphic Design Composition
by: Lin, Jiawei, et al.
Published: (2024) -
Can Vision Language Models Assess Graphic Design Aesthetics? A Benchmark, Evaluation, and Dataset Perspective
by: An, Arctanx, et al.
Published: (2026) -
Desigen: A Pipeline for Controllable Design Template Generation
by: Weng, Haohan, et al.
Published: (2024) -
Graphic Design with Large Multimodal Model
by: Cheng, Yutao, et al.
Published: (2024)