Cover Image

ColorBench: Can VLMs See and Understand the Colorful World? A Comprehensive Benchmark for Color Perception, Reasoning, and Robustness

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liang, Yijun, Li, Ming, Fan, Chenrui, Li, Ziyue, Nguyen, Dang, Cobbina, Kwesi, Bhardwaj, Shweta, Chen, Jiuhai, Liu, Fuxiao, Zhou, Tianyi
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence Computation and Language Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

V-REX: Benchmarking Exploratory Visual Reasoning via Chain-of-Questions
by: Fan, Chenrui, et al.
Published: (2025)

Where to show Demos in Your Prompt: A Positional Bias of In-Context Learning
by: Cobbina, Kwesi, et al.
Published: (2025)

ColorBench: Benchmarking Mobile Agents with Graph-Structured Framework for Complex Long-Horizon Tasks
by: Song, Yuanyi, et al.
Published: (2025)

ColorConceptBench: A Benchmark for Probabilistic Color-Concept Understanding in Text-to-Image Models
by: Ruan, Chenxi, et al.
Published: (2026)

Multi-Objective Linguistic Control of Large Language Models
by: Nguyen, Dang, et al.
Published: (2024)

Diffusion Curriculum: Synthetic-to-Real Data Curriculum via Image-Guided Diffusion
by: Liang, Yijun, et al.
Published: (2024)

On the Perception Bottleneck of VLMs for Chart Understanding
by: Liu, Junteng, et al.
Published: (2025)

Colors See Colors Ignore: Clothes Changing ReID with Color Disentanglement
by: Pathak, Priyank, et al.
Published: (2025)

GenColorBench: A Color Evaluation Benchmark for Text-to-Image Generation Models
by: Butt, Muhammad Atif, et al.
Published: (2025)

Benchmarked Yet Not Measured -- Generative AI Should be Evaluated Against Real-World Utility
by: Mondal, Ishani, et al.
Published: (2026)

VisualActBench: Can VLMs See and Act like a Human?
by: Zhang, Daoan, et al.
Published: (2025)

Working with Color: How Color Quantization Can Aid Researchers of Problematic Information
by: Lutz, Nina, et al.
Published: (2024)

Color Bind: Exploring Color Perception in Text-to-Image Models
by: Shomer-Chai, Shay, et al.
Published: (2025)

Can LLMs Speak For Diverse People? Tuning LLMs via Debate to Generate Controllable Controversial Statements
by: Li, Ming, et al.
Published: (2024)

ColorFLUX: A Structure-Color Decoupling Framework for Old Photo Colorization
by: Li, Bingchen, et al.
Published: (2026)

ColorBlindnessEval: Can Vision-Language Models Pass Color Blindness Tests?
by: Ling, Zijian, et al.
Published: (2025)

Comparative Analysis Of Color Models For Human Perception And Visual Color Difference
by: Burambekova, Aruzhan, et al.
Published: (2024)

Seeing is Not Understanding: A Benchmark on Perception-Cognition Disparities in Large Language Models
by: Li, Haokun, et al.
Published: (2025)

MuirBench: A Comprehensive Benchmark for Robust Multi-image Understanding
by: Wang, Fei, et al.
Published: (2024)

PTGCF: Printing Texture Guided Color Fusion for Impressionism Oil Painting Style Rendering
by: Geng, Jing, et al.
Published: (2022)

Control Color: Multimodal Diffusion-based Interactive Image Colorization
by: Liang, Zhexin, et al.
Published: (2024)

Language-based Image Colorization: A Benchmark and Beyond
by: Li, Yifan, et al.
Published: (2025)

IndicVisionBench: Benchmarking Cultural and Multilingual Understanding in VLMs
by: Faraz, Ali, et al.
Published: (2025)

CCC: Color Classified Colorization
by: Gain, Mrityunjoy, et al.
Published: (2024)

Paint Bucket Colorization Using Anime Character Color Design Sheets
by: Dai, Yuekun, et al.
Published: (2024)

My LLM might Mimic AAE -- But When Should it?
by: Sandoval, Sandra C., et al.
Published: (2025)

The Four Color Theorem for Cell Instance Segmentation
by: Zhang, Ye, et al.
Published: (2025)

Stepwise Guided Policy Optimization: Coloring your Incorrect Reasoning in GRPO
by: Chen, Peter, et al.
Published: (2025)

Color Alignment in Diffusion
by: Shum, Ka Chun, et al.
Published: (2025)

L-C4: Language-Based Video Colorization for Creative and Consistent Color
by: Chang, Zheng, et al.
Published: (2024)

OmniColor: A Unified Framework for Multi-modal Lineart Colorization
by: Zhang, Xulu, et al.
Published: (2026)

Evaluating the Semantic Profiling Abilities of LLMs for Natural Language Utterances in Data Visualization
by: Bako, Hannah K., et al.
Published: (2024)

AnimeColor: Reference-based Animation Colorization with Diffusion Transformers
by: Zhang, Yuhong, et al.
Published: (2025)

Color and Frequency Correction for Image Colorization
by: Zhuang, Yun Kai
Published: (2025)

Understanding and Rectifying Safety Perception Distortion in VLMs
by: Zou, Xiaohan, et al.
Published: (2025)

ColorGS: High-fidelity Surgical Scene Reconstruction with Colored Gaussian Splatting
by: Ji, Qun, et al.
Published: (2025)

MultiColor: Image Colorization by Learning from Multiple Color Spaces
by: Du, Xiangcheng, et al.
Published: (2024)

Color3D: Controllable and Consistent 3D Colorization with Personalized Colorizer
by: Wan, Yecong, et al.
Published: (2025)

GenColor: Generative Color-Concept Association in Visual Design
by: Hou, Yihan, et al.
Published: (2025)

Can World Models Benefit VLMs for World Dynamics?
by: Zhang, Kevin, et al.
Published: (2025)