Image de couverture de livre

Who Evaluates the Evaluations? Objectively Scoring Text-to-Image Prompt Coherence Metrics with T2IScoreScore (TS2)

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Saxon, Michael, Jahara, Fatima, Khoshnoodi, Mahsa, Lu, Yujie, Sharma, Aditya, Wang, William Yang
Format:	Preprint
Publié:	2024
Sujets:	Computer Vision and Pattern Recognition Artificial Intelligence Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Evaluating Implicit Biases in LLM Reasoning through Logic Grid Puzzles
par: Jahara, Fatima, et autres
Publié: (2025)

Losing Visual Needles in Image Haystacks: Vision Language Models are Easily Distracted in Short and Long Contexts
par: Sharma, Aditya, et autres
Publié: (2024)

Hierarchical Prompting Taxonomy: A Universal Evaluation Framework for Large Language Models Aligned with Human Cognitive Principles
par: Budagam, Devichand, et autres
Publié: (2024)

TIT-Score: Evaluating Long-Prompt Based Text-to-Image Alignment via Text-to-Image-to-Text Consistency
par: Wang, Juntong, et autres
Publié: (2025)

VideoScore2: Think before You Score in Generative Video Evaluation
par: He, Xuan, et autres
Publié: (2025)

CrossScore: Towards Multi-View Image Evaluation and Scoring
par: Wang, Zirui, et autres
Publié: (2024)

CAIRe: Cultural Attribution of Images by Retrieval-Augmented Evaluation
par: Yayavaram, Arnav, et autres
Publié: (2025)

TypeScore: A Text Fidelity Metric for Text-to-Image Generative Models
par: Sampaio, Georgia Gabriela, et autres
Publié: (2024)

Evaluating the Evaluators: Metrics for Compositional Text-to-Image Generation
par: Kasaei, Seyed Amir, et autres
Publié: (2025)

Revisiting Text-to-Image Evaluation with Gecko: On Metrics, Prompts, and Human Ratings
par: Wiles, Olivia, et autres
Publié: (2024)

Alignment Scores: Robust Metrics for Multiview Pose Accuracy Evaluation
par: Lee, Seong Hun, et autres
Publié: (2024)

DiffScore: Text Evaluation Beyond Autoregressive Likelihood
par: Lai, Wen, et autres
Publié: (2026)

RadReason: Radiology Report Evaluation Metric with Reasons and Sub-Scores
par: Li, Yingshu, et autres
Publié: (2025)

ContrastScore: Towards Higher Quality, Less Biased, More Efficient Evaluation Metrics with Contrastive Evaluation
par: Wang, Xiao, et autres
Publié: (2025)

MSD-Score: Multi-Scale Distributional Scoring for Reference-Free Image Caption Evaluation
par: Kan, Shichao, et autres
Publié: (2026)

Good Scores, Bad Data: A Metric for Multimodal Coherence
par: Srinivasan, Vasundra
Publié: (2026)

In-Situ Behavioral Evaluation for LLM Fairness, Not Standardized-Test Scores
par: Tang, Zeyu, et autres
Publié: (2026)

FedDriveScore: Federated Scoring Driving Behavior with a Mixture of Metric Distributions
par: Lu, Lin
Publié: (2024)

Prompt Stability Scoring for Text Annotation with Large Language Models
par: Barrie, Christopher, et autres
Publié: (2024)

A Comprehensive Survey of Accelerated Generation Techniques in Large Language Models
par: Khoshnoodi, Mahsa, et autres
Publié: (2024)

SPECS: Specificity-Enhanced CLIP-Score for Long Image Caption Evaluation
par: Chen, Xiaofu, et autres
Publié: (2025)

Towards Evaluating Robustness of Prompt Adherence in Text to Image Models
par: Vemishetty, Sujith, et autres
Publié: (2025)

Lost in Translation? Translation Errors and Challenges for Fair Assessment of Text-to-Image Models on Multilingual Concepts
par: Saxon, Michael, et autres
Publié: (2024)

TC-Bench: Benchmarking Temporal Compositionality in Text-to-Video and Image-to-Video Generation
par: Feng, Weixi, et autres
Publié: (2024)

Image Score: Learning and Evaluating Human Preferences for Mercari Search
par: Oinar, Chingis, et autres
Publié: (2024)

World Consistency Score: A Unified Metric for Video Generation Quality
par: Rakheja, Akshat, et autres
Publié: (2025)

Evaluation Metrics for Text Data Augmentation in NLP
par: Amadeus, Marcellus, et autres
Publié: (2024)

LLMs as Narcissistic Evaluators: When Ego Inflates Evaluation Scores
par: Liu, Yiqi, et autres
Publié: (2023)

Image Interpolation with Score-based Riemannian Metrics of Diffusion Models
par: Saito, Shinnosuke, et autres
Publié: (2025)

A Quantitative Evaluation of Score Distillation Sampling Based Text-to-3D
par: Fei, Xiaohan, et autres
Publié: (2024)

OpenFActScore: Open-Source Atomic Evaluation of Factuality in Text Generation
par: Lage, Lucas Fonseca, et autres
Publié: (2025)

Concept-Guided Chain-of-Thought Prompting for Pairwise Comparison Scoring of Texts with Large Language Models
par: Wu, Patrick Y., et autres
Publié: (2023)

Scendi Score: Prompt-Aware Diversity Evaluation via Schur Complement of CLIP Embeddings
par: Ospanov, Azim, et autres
Publié: (2024)

Evaluating Scoring Bias in LLM-as-a-Judge
par: Li, Qingquan, et autres
Publié: (2025)

PEEM: Prompt Engineering Evaluation Metrics for Interpretable Joint Evaluation of Prompts and Responses
par: Hong, Minki, et autres
Publié: (2026)

TIAM -- A Metric for Evaluating Alignment in Text-to-Image Generation
par: Grimal, Paul, et autres
Publié: (2023)

Ran Score: a LLM-based Evaluation Score for Radiology Report Generation
par: Zhang, Ran, et autres
Publié: (2026)

Mean Opinion Score as a New Metric for User-Evaluation of XAI Methods
par: Yu, Hyeon, et autres
Publié: (2024)

Adapting AlignScore Mertic for Factual Consistency Evaluation of Text in Russian: A Student Abstract
par: Zimin, Mikhail, et autres
Publié: (2025)

T2I-FineEval: Fine-Grained Compositional Metric for Text-to-Image Evaluation
par: Hosseini, Seyed Mohammad Hadi, et autres
Publié: (2025)