Cover Image

Foundational Autoraters: Taming Large Language Models for Better Automatic Evaluation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Vu, Tu, Krishna, Kalpesh, Alzubi, Salaheddin, Tar, Chris, Faruqui, Manaal, Sung, Yun-Hsuan
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

What Matters for Model Merging at Scale?
by: Yadav, Prateek, et al.
Published: (2024)

Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
by: Munkhdalai, Tsendsuren, et al.
Published: (2024)

EvoSkill: Automated Skill Discovery for Multi-Agent Systems
by: Alzubi, Salaheddin, et al.
Published: (2026)

AutoMix: Automatically Mixing Language Models
by: Aggarwal, Pranjal, et al.
Published: (2023)

Fact, Fetch, and Reason: A Unified Evaluation of Retrieval-Augmented Generation
by: Krishna, Satyapriya, et al.
Published: (2024)

PostMark: A Robust Blackbox Watermark for Large Language Models
by: Chang, Yapei, et al.
Published: (2024)

Audio Jailbreaks in Large Audio-Language Models: Taxonomy, Attack-Defense Analysis, and Cost-Aware Evaluation
by: Feng, Bo-Han, et al.
Published: (2026)

SED: Self-Evaluation Decoding Enhances Large Language Models for Better Generation
by: Luo, Ziqin, et al.
Published: (2024)

Distract Large Language Models for Automatic Jailbreak Attack
by: Xiao, Zeguan, et al.
Published: (2024)

Meta Large Language Model Compiler: Foundation Models of Compiler Optimization
by: Cummins, Chris, et al.
Published: (2024)

ROMA: Recursive Open Meta-Agent Framework for Long-Horizon Multi-Agent Systems
by: Alzu'bi, Salaheddin, et al.
Published: (2026)

Automatically Extracting Numerical Results from Randomized Controlled Trials with Large Language Models
by: Yun, Hye Sun, et al.
Published: (2024)

SaGE: Evaluating Moral Consistency in Large Language Models
by: Bonagiri, Vamshi Krishna, et al.
Published: (2024)

Automatic Instruction Evolving for Large Language Models
by: Zeng, Weihao, et al.
Published: (2024)

RefuteBench: Evaluating Refuting Instruction-Following for Large Language Models
by: Yan, Jianhao, et al.
Published: (2024)

WaterBench: Towards Holistic Evaluation of Watermarks for Large Language Models
by: Tu, Shangqing, et al.
Published: (2023)

Rate, Explain and Cite (REC): Enhanced Explanation and Attribution in Automatic Evaluation by Large Language Models
by: Hsu, Aliyah R., et al.
Published: (2024)

ARS: Automatic Routing Solver with Large Language Models
by: Li, Kai, et al.
Published: (2025)

Arabic Automatic Story Generation with Large Language Models
by: El-Shangiti, Ahmed Oumar, et al.
Published: (2024)

Elsevier Arena: Human Evaluation of Chemistry/Biology/Health Foundational Large Language Models
by: Thorne, Camilo, et al.
Published: (2024)

Supervised Knowledge Makes Large Language Models Better In-context Learners
by: Yang, Linyi, et al.
Published: (2023)

The Real, the Better: Aligning Large Language Models with Online Human Behaviors
by: Jiang, Guanying, et al.
Published: (2024)

Tracing Moral Foundations in Large Language Models
by: Yu, Chenxiao, et al.
Published: (2026)

Architectural Foundations for the Large Language Model Infrastructures
by: Zhu, Hongyin
Published: (2024)

CDGP: Automatic Cloze Distractor Generation based on Pre-trained Language Model
by: Chiang, Shang-Hsuan, et al.
Published: (2024)

Automatic Adaptation Rule Optimization via Large Language Models
by: Ishimizu, Yusei, et al.
Published: (2024)

Automatically Planning Optimal Parallel Strategy for Large Language Models
by: Li, Zongbiao, et al.
Published: (2024)

Promptomatix: An Automatic Prompt Optimization Framework for Large Language Models
by: Murthy, Rithesh, et al.
Published: (2025)

Applying Large Language Models and Chain-of-Thought for Automatic Scoring
by: Lee, Gyeong-Geon, et al.
Published: (2023)

Automatic Input Rewriting Improves Translation with Large Language Models
by: Ki, Dayeon, et al.
Published: (2025)

LoASR-Bench: Evaluating Large Speech Language Models on Low-Resource Automatic Speech Recognition Across Language Families
by: Chen, Jianan, et al.
Published: (2026)

Collaboration among Multiple Large Language Models for Medical Question Answering
by: Shang, Kexin, et al.
Published: (2025)

Foundations of Large Language Models
by: Xiao, Tong, et al.
Published: (2025)

Theoretical Foundations and Mitigation of Hallucination in Large Language Models
by: Gumaan, Esmail
Published: (2025)

Can Small Language Models Help Large Language Models Reason Better?: LM-Guided Chain-of-Thought
by: Lee, Jooyoung, et al.
Published: (2024)

Curiosity-driven Red-teaming for Large Language Models
by: Hong, Zhang-Wei, et al.
Published: (2024)

Test-Time Fairness and Robustness in Large Language Models
by: Cotta, Leonardo, et al.
Published: (2024)

Can Large Language Models Automatically Score Proficiency of Written Essays?
by: Mansour, Watheq, et al.
Published: (2024)

$π^2$: Structure-Originated Reasoning Data Improves Long-Context Reasoning Ability of Large Language Models
by: Do, Quyet V., et al.
Published: (2026)

A Novel Computational and Modeling Foundation for Automatic Coherence Assessment
by: Maimon, Aviya, et al.
Published: (2023)