Image de couverture de livre

Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluation

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Lee, Seongyun, Kim, Seungone, Park, Sue Hyun, Kim, Geewook, Seo, Minjoon
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

How Does Vision-Language Adaptation Impact the Safety of Vision Language Models?
par: Lee, Seongyun, et autres
Publié: (2024)

Aligning to Thousands of Preferences via System Message Generalization
par: Lee, Seongyun, et autres
Publié: (2024)

On Efficient Language and Vision Assistants for Visually-Situated Natural Language Understanding: What Matters in Reading and Reasoning
par: Kim, Geewook, et autres
Publié: (2024)

Prometheus: Inducing Fine-grained Evaluation Capability in Language Models
par: Kim, Seungone, et autres
Publié: (2023)

Volcano: Mitigating Multimodal Hallucination through Self-Feedback Guided Revision
par: Lee, Seongyun, et autres
Publié: (2023)

Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models
par: Kim, Seungone, et autres
Publié: (2024)

Self-Explore: Enhancing Mathematical Reasoning in Language Models with Fine-grained Rewards
par: Hwang, Hyeonbin, et autres
Publié: (2024)

State-Space Hierarchical Compression with Gated Attention and Learnable Sampling for Hour-Long Video Understanding in Large Multimodal Models
par: Kim, Geewook, et autres
Publié: (2025)

FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
par: Ye, Seonghyeon, et autres
Publié: (2023)

Do Modern Video-LLMs Need to Listen? A Benchmark Audit and Scalable Remedy
par: Kim, Geewook, et autres
Publié: (2025)

Lost in the Noise: How Reasoning Models Fail with Contextual Distractors
par: Lee, Seongyun, et autres
Publié: (2026)

The CoT Encyclopedia: Analyzing, Predicting, and Controlling how a Reasoning Model will Think
par: Lee, Seongyun, et autres
Publié: (2025)

M-Prometheus: A Suite of Open Multilingual LLM Judges
par: Pombal, José, et autres
Publié: (2025)

Evaluating Multimodal Generative AI with Korean Educational Standards
par: Park, Sanghee, et autres
Publié: (2025)

Can Language Models Evaluate Human Written Text? Case Study on Korean Student Writing for Education
par: Kim, Seungyoon, et autres
Publié: (2024)

LangBridge: Multilingual Reasoning Without Multilingual Supervision
par: Yoon, Dongkeun, et autres
Publié: (2024)

The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models
par: Kim, Seungone, et autres
Publié: (2024)

Hierarchical Deconstruction of LLM Reasoning: A Graph-Based Framework for Analyzing Knowledge Utilization
par: Ko, Miyoung, et autres
Publié: (2024)

Rethinking the Role of Proxy Rewards in Language Model Alignment
par: Kim, Sungdong, et autres
Publié: (2024)

Evaluating Language Models as Synthetic Data Generators
par: Kim, Seungone, et autres
Publié: (2024)

TSLM: Tree-Structured Language Modeling for Divergent Thinking
par: Kim, Doyoung, et autres
Publié: (2026)

Can Large Language Models Keep Up? Benchmarking Online Adaptation to Continual Knowledge Streams
par: Kim, Jiyeon, et autres
Publié: (2026)

How language models extrapolate outside the training data: A case study in Textualized Gridworld
par: Kim, Doyoung, et autres
Publié: (2024)

Reasoning Models Better Express Their Confidence
par: Yoon, Dongkeun, et autres
Publié: (2025)

Scaling Evaluation-time Compute with Reasoning Models as Evaluators
par: Kim, Seungone, et autres
Publié: (2025)

Fine-Grained and Thematic Evaluation of LLMs in Social Deduction Game
par: Kim, Byungjun, et autres
Publié: (2024)

Finer: Investigating and Enhancing Fine-Grained Visual Concept Recognition in Large Vision Language Models
par: Kim, Jeonghwan, et autres
Publié: (2024)

MMRefine: Unveiling the Obstacles to Robust Refinement in Multimodal Large Language Models
par: Paik, Gio, et autres
Publié: (2025)

VideoJudge: Bootstrapping Enables Scalable Supervision of MLLM-as-a-Judge for Video Understanding
par: Waheed, Abdul, et autres
Publié: (2025)

Early Decisions Matter: Proximity Bias and Initial Trajectory Shaping in Non-Autoregressive Diffusion Language Models
par: Kim, Jiyeon, et autres
Publié: (2026)

Fine-Grained Evaluation of Large Vision-Language Models in Autonomous Driving
par: Li, Yue, et autres
Publié: (2025)

LG AI Research & KAIST at EHRSQL 2024: Self-Training Large Language Models with Pseudo-Labeled Unanswerable Questions for a Reliable Text-to-SQL System on EHRs
par: Jo, Yongrae, et autres
Publié: (2024)

How Well Do Large Language Models Truly Ground?
par: Lee, Hyunji, et autres
Publié: (2023)

K-BrowseComp: A Web Browsing Agent Benchmark Grounded in Korean Contexts
par: Lee, Nahyun, et autres
Publié: (2026)

Latent Reasoning via Sentence Embedding Prediction
par: Hwang, Hyeonbin, et autres
Publié: (2025)

Improving Probability-based Prompt Selection Through Unified Evaluation and Analysis
par: Yang, Sohee, et autres
Publié: (2023)

Understanding and Enhancing Mamba-Transformer Hybrids for Memory Recall and Language Modeling
par: Lee, Hyunji, et autres
Publié: (2025)

MM-Eval: A Multilingual Meta-Evaluation Benchmark for LLM-as-a-Judge and Reward Models
par: Son, Guijin, et autres
Publié: (2024)

Instruction Tuning with and without Context: Behavioral Shifts and Downstream Impact
par: Lee, Hyunji, et autres
Publié: (2025)

Pedagogical Alignment for Vision-Language-Action Models: A Comprehensive Framework for Data, Architecture, and Evaluation in Education
par: Lee, Unggi, et autres
Publié: (2026)