Copertina

Prometheus: Inducing Fine-grained Evaluation Capability in Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Kim, Seungone, Shin, Jamin, Cho, Yejin, Jang, Joel, Longpre, Shayne, Lee, Hwaran, Yun, Sangdoo, Shin, Seongjin, Kim, Sungdong, Thorne, James, Seo, Minjoon
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Computation and Language Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models
di: Kim, Seungone, et al.
Pubblicazione: (2024)

Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluation
di: Lee, Seongyun, et al.
Pubblicazione: (2024)

FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets
di: Ye, Seonghyeon, et al.
Pubblicazione: (2023)

LangBridge: Multilingual Reasoning Without Multilingual Supervision
di: Yoon, Dongkeun, et al.
Pubblicazione: (2024)

Rethinking the Role of Proxy Rewards in Language Model Alignment
di: Kim, Sungdong, et al.
Pubblicazione: (2024)

Self-Explore: Enhancing Mathematical Reasoning in Language Models with Fine-grained Rewards
di: Hwang, Hyeonbin, et al.
Pubblicazione: (2024)

The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Models
di: Kim, Seungone, et al.
Pubblicazione: (2024)

Who Wrote this Code? Watermarking for Code Generation
di: Lee, Taehyun, et al.
Pubblicazione: (2023)

Revealing User Familiarity Bias in Task-Oriented Dialogue via Interactive Evaluation
di: Kim, Takyoung, et al.
Pubblicazione: (2023)

Generative Prompt Internalization
di: Shin, Haebin, et al.
Pubblicazione: (2024)

Aligning to Thousands of Preferences via System Message Generalization
di: Lee, Seongyun, et al.
Pubblicazione: (2024)

TimeChara: Evaluating Point-in-Time Character Hallucination of Role-Playing Large Language Models
di: Ahn, Jaewoo, et al.
Pubblicazione: (2024)

Improving Probability-based Prompt Selection Through Unified Evaluation and Analysis
di: Yang, Sohee, et al.
Pubblicazione: (2023)

Future and AI-Ready Data Strategies: Response to DOC RFI on AI and Open Government Data Assets
di: Oderinwale, Hamidah, et al.
Pubblicazione: (2024)

Aligning Large Language Models by On-Policy Self-Judgment
di: Lee, Sangkyu, et al.
Pubblicazione: (2024)

Code-Switching Curriculum Learning for Multilingual Transfer in LLMs
di: Yoo, Haneul, et al.
Pubblicazione: (2024)

EvalLM: Interactive Evaluation of Large Language Model Prompts on User-Defined Criteria
di: Kim, Tae Soo, et al.
Pubblicazione: (2023)

Secure User-friendly Blockchain Modular Wallet Design Using Android & OP-TEE
di: Kim, Seongjin, et al.
Pubblicazione: (2025)

Real-time Calibration Model for Low-cost Sensor in Fine-grained Time series
di: Ahn, Seokho, et al.
Pubblicazione: (2024)

TRAP: Targeted Random Adversarial Prompt Honeypot for Black-Box Identification
di: Gubri, Martin, et al.
Pubblicazione: (2024)

Calibrating Large Language Models Using Their Generations Only
di: Ulmer, Dennis, et al.
Pubblicazione: (2024)

Do Modern Video-LLMs Need to Listen? A Benchmark Audit and Scalable Remedy
di: Kim, Geewook, et al.
Pubblicazione: (2025)

State-Space Hierarchical Compression with Gated Attention and Learnable Sampling for Hour-Long Video Understanding in Large Multimodal Models
di: Kim, Geewook, et al.
Pubblicazione: (2025)

On Efficient Language and Vision Assistants for Visually-Situated Natural Language Understanding: What Matters in Reading and Reasoning
di: Kim, Geewook, et al.
Pubblicazione: (2024)

Exploring the Practicality of Generative Retrieval on Dynamic Corpora
di: Kim, Chaeeun, et al.
Pubblicazione: (2023)

Influences of serving temperatures on human perceived spiciness intensity of commercial spicy sauces
di: Seo‐yeong Chon, et al.
Pubblicazione: (2024)

Fast KVzip: Efficient and Accurate LLM Inference with Gated KV Eviction
di: Kim, Jang-Hyun, et al.
Pubblicazione: (2026)

How Well Do Large Language Models Truly Ground?
di: Lee, Hyunji, et al.
Pubblicazione: (2023)

M-Prometheus: A Suite of Open Multilingual LLM Judges
di: Pombal, José, et al.
Pubblicazione: (2025)

Can Language Models Evaluate Human Written Text? Case Study on Korean Student Writing for Education
di: Kim, Seungyoon, et al.
Pubblicazione: (2024)

Reasoning Models Better Express Their Confidence
di: Yoon, Dongkeun, et al.
Pubblicazione: (2025)

WorldKV: Efficient World Memory with World Retrieval and Compression
di: Yi, Jung, et al.
Pubblicazione: (2026)

Knowledge Entropy Decay during Language Model Pretraining Hinders New Knowledge Acquisition
di: Kim, Jiyeon, et al.
Pubblicazione: (2024)

Semiparametric Token-Sequence Co-Supervision
di: Lee, Hyunji, et al.
Pubblicazione: (2024)

KTRL+F: Knowledge-Augmented In-Document Search
di: Oh, Hanseok, et al.
Pubblicazione: (2023)

Temperature‐dependent thermodynamic and kinetic analysis of ketohexose tautomerism by quantitative 1 H NMR : A comparative study of D‐fructose and D‐allulose
di: Hyojin Cho, et al.
Pubblicazione: (2026)

INSTRUCTIR: A Benchmark for Instruction Following of Information Retrieval Models
di: Oh, Hanseok, et al.
Pubblicazione: (2024)

FREESON: Retriever-Free Retrieval-Augmented Reasoning via Corpus-Traversing MCTS
di: Kim, Chaeeun, et al.
Pubblicazione: (2025)

TSLM: Tree-Structured Language Modeling for Divergent Thinking
di: Kim, Doyoung, et al.
Pubblicazione: (2026)

How language models extrapolate outside the training data: A case study in Textualized Gridworld
di: Kim, Doyoung, et al.
Pubblicazione: (2024)