Copertina

MMGenBench: Fully Automatically Evaluating LMMs from the Text-to-Image Generation Perspective

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Huang, Hailang, Wang, Yong, Huang, Zixuan, Li, Huaqiu, Huang, Tongwen, Chu, Xiangxiang, Zhang, Richong
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computer Vision and Pattern Recognition Artificial Intelligence Computation and Language Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

LD-RPS: Zero-Shot Unified Image Restoration via Latent Diffusion Recurrent Posterior Sampling
di: Li, Huaqiu, et al.
Pubblicazione: (2025)

Thinking with Map: Reinforced Parallel Map-Augmented Agent for Geolocalization
di: Ji, Yuxiang, et al.
Pubblicazione: (2026)

R2I-Bench: Benchmarking Reasoning-Driven Text-to-Image Generation
di: Chen, Kaijie, et al.
Pubblicazione: (2025)

Image2Text2Image: A Novel Framework for Label-Free Evaluation of Image-to-Text Generation with Text-to-Image Diffusion Models
di: Huang, Jia-Hong, et al.
Pubblicazione: (2024)

ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generation
di: Yuan, Shenghai, et al.
Pubblicazione: (2024)

MMGen: Unified Multi-modal Image Generation and Understanding in One Go
di: Wang, Jiepeng, et al.
Pubblicazione: (2025)

LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Models
di: Zhang, Kaichen, et al.
Pubblicazione: (2024)

Fast Prompt Alignment for Text-to-Image Generation
di: Mrini, Khalil, et al.
Pubblicazione: (2024)

All Languages Matter: Evaluating LMMs on Culturally Diverse 100 Languages
di: Vayani, Ashmal, et al.
Pubblicazione: (2024)

Holistic Evaluation for Interleaved Text-and-Image Generation
di: Liu, Minqian, et al.
Pubblicazione: (2024)

CrossWordBench: Evaluating the Reasoning Capabilities of LLMs and LVLMs with Controllable Puzzle Generation
di: Leng, Jixuan, et al.
Pubblicazione: (2025)

Cross-Modal and Uni-Modal Soft-Label Alignment for Image-Text Retrieval
di: Huang, Hailang, et al.
Pubblicazione: (2024)

Multimodal RewardBench 2: Evaluating Omni Reward Models for Interleaved Text and Image
di: Hu, Yushi, et al.
Pubblicazione: (2025)

MMSearch-R1: Incentivizing LMMs to Search
di: Wu, Jinming, et al.
Pubblicazione: (2025)

Re-Thinking the Automatic Evaluation of Image-Text Alignment in Text-to-Image Models
di: Zhang, Huixuan, et al.
Pubblicazione: (2025)

Automatic Evaluation for Text-to-image Generation: Task-decomposed Framework, Distilled Training, and Meta-evaluation Benchmark
di: Tu, Rong-Cheng, et al.
Pubblicazione: (2024)

MOAT: Evaluating LMMs for Capability Integration and Instruction Grounding
di: Ye, Zhoutong, et al.
Pubblicazione: (2025)

FLUX-Reason-6M & PRISM-Bench: A Million-Scale Text-to-Image Reasoning Dataset and Comprehensive Benchmark
di: Fang, Rongyao, et al.
Pubblicazione: (2025)

Evaluating the Evaluators: Metrics for Compositional Text-to-Image Generation
di: Kasaei, Seyed Amir, et al.
Pubblicazione: (2025)

Hallucination as an Upper Bound: A New Perspective on Text-to-Image Evaluation
di: Kasaei, Seyed Amir, et al.
Pubblicazione: (2025)

A-Bench: Are LMMs Masters at Evaluating AI-generated Images?
di: Zhang, Zicheng, et al.
Pubblicazione: (2024)

USP: Unified Self-Supervised Pretraining for Image Generation and Understanding
di: Chu, Xiangxiang, et al.
Pubblicazione: (2025)

Taming the Tri-Space Tension: ARC-Guided Hallucination Modeling and Control for Text-to-Image Generation
di: Yang, Jianjiang, et al.
Pubblicazione: (2025)

Enhancing Journalism with AI: A Study of Contextualized Image Captioning for News Articles using LLMs and LMMs
di: Anagnostopoulou, Aliki, et al.
Pubblicazione: (2024)

VANE-Bench: Video Anomaly Evaluation Benchmark for Conversational LMMs
di: Bharadwaj, Rohit, et al.
Pubblicazione: (2024)

Towards Automatic Evaluation for Image Transcreation
di: Khanuja, Simran, et al.
Pubblicazione: (2024)

Perception Without Engagement: Dissecting the Causal Discovery Deficit in LMMs
di: Liang, Jiafeng, et al.
Pubblicazione: (2026)

Interleaved Scene Graphs for Interleaved Text-and-Image Generation Assessment
di: Chen, Dongping, et al.
Pubblicazione: (2024)

Improving Text-to-Image Consistency via Automatic Prompt Optimization
di: Mañas, Oscar, et al.
Pubblicazione: (2024)

DiffChat: Learning to Chat with Text-to-Image Synthesis Models for Interactive Image Creation
di: Wang, Jiapeng, et al.
Pubblicazione: (2024)

MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?
di: Chen, Zhaorun, et al.
Pubblicazione: (2024)

AutoHallusion: Automatic Generation of Hallucination Benchmarks for Vision-Language Models
di: Wu, Xiyang, et al.
Pubblicazione: (2024)

Video-SafetyBench: A Benchmark for Safety Evaluation of Video LVLMs
di: Liu, Xuannan, et al.
Pubblicazione: (2025)

A Survey of Automatic Evaluation Methods on Text, Visual and Speech Generations
di: Lan, Tian, et al.
Pubblicazione: (2025)

Multimodal Abstractive Summarization of Instructional Videos with Vision-Language Models
di: Nazir, Maham, et al.
Pubblicazione: (2026)

Geometry-Aware Losses for Structure-Preserving Text-to-Sign Language Generation
di: Wu, Zetian, et al.
Pubblicazione: (2025)

AesBench: An Expert Benchmark for Multimodal Large Language Models on Image Aesthetics Perception
di: Huang, Yipo, et al.
Pubblicazione: (2024)

TC-Bench: Benchmarking Temporal Compositionality in Text-to-Video and Image-to-Video Generation
di: Feng, Weixi, et al.
Pubblicazione: (2024)

MMFakeBench: A Mixed-Source Multimodal Misinformation Detection Benchmark for LVLMs
di: Liu, Xuannan, et al.
Pubblicazione: (2024)

Evaluating Semantic Variation in Text-to-Image Synthesis: A Causal Perspective
di: Zhu, Xiangru, et al.
Pubblicazione: (2024)