Cover Image

Auto-PRE: An Automatic and Cost-Efficient Peer-Review Framework for Language Generation Evaluation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Junjie, Su, Weihang, Chu, Zhumin, Li, Haitao, Zhou, Yujia, Yuan, Dingbo, Wang, Xudong, Zhou, Jun, Liu, Yiqun, Zhang, Min, Ma, Shaoping, Ai, Qingyao
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

PRE: A Peer Review Based Large Language Model Evaluator
by: Chu, Zhumin, et al.
Published: (2024)

Overview of the NTCIR-18 Automatic Evaluation of LLMs (AEOLLM) Task
by: Chen, Junjie, et al.
Published: (2025)

CalibraEval: Calibrating Prediction Distribution to Mitigate Selection Bias in LLMs-as-Judges
by: Li, Haitao, et al.
Published: (2024)

Augmenting Multi-Agent Communication with State Delta Trajectory
by: Tang, Yichen, et al.
Published: (2025)

RbFT: Robust Fine-tuning for Retrieval-Augmented Generation against Retrieval Defects
by: Tu, Yiteng, et al.
Published: (2025)

Decoupling Reasoning and Knowledge Injection for In-Context Knowledge Editing
by: Wang, Changyue, et al.
Published: (2025)

ATACompressor: Adaptive Task-Aware Compression for Efficient Long-Context Processing in LLMs
by: Li, Xuancheng, et al.
Published: (2026)

Towards Better Understanding of User Satisfaction in Open-Domain Conversational Search
by: Chu, Zhumin, et al.
Published: (2022)

MulFeRL: Enhancing Reinforcement Learning with Verbal Feedback in a Multi-turn Loop
by: Li, Xuancheng, et al.
Published: (2026)

Beyond Experience Retrieval: Learning to Generate Utility-Optimized Structured Experience for Frozen LLMs
by: Li, Xuancheng, et al.
Published: (2026)

Benchmarking LLM-as-a-Judge for Long-Form Output Evaluation
by: Chen, Junjie, et al.
Published: (2026)

Improve Large Language Model Systems with User Logs
by: Wang, Changyue, et al.
Published: (2026)

Multi-Field Tool Retrieval
by: Tang, Yichen, et al.
Published: (2026)

Joint Evaluation of Answer and Reasoning Consistency for Hallucination Detection in Large Reasoning Models
by: Wang, Changyue, et al.
Published: (2025)

Decoupling Knowledge and Task Subspaces for Composable Parametric Retrieval Augmented Generation
by: Su, Weihang, et al.
Published: (2026)

Generalized Pseudo-Relevance Feedback
by: Tu, Yiteng, et al.
Published: (2025)

Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language Models
by: Su, Weihang, et al.
Published: (2024)

LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods
by: Li, Haitao, et al.
Published: (2024)

From <Answer> to <Think>: Multidimensional Supervision of Reasoning Process for LLM Optimization
by: Wang, Beining, et al.
Published: (2025)

Evaluation Ethics of LLMs in Legal Domain
by: Zhang, Ruizhe, et al.
Published: (2024)

Chinese Court Simulation with LLM-Based Agent System
by: Zhang, Kaiyuan, et al.
Published: (2025)

LeKUBE: A Legal Knowledge Update BEnchmark
by: Wang, Changyue, et al.
Published: (2024)

Equity vs. Equality: Optimizing Ranking Fairness for Tailored Provider Needs
by: Tu, Yiteng, et al.
Published: (2026)

Knowledge Editing through Chain-of-Thought
by: Wang, Changyue, et al.
Published: (2024)

Enhancing Judgment Document Generation via Agentic Legal Information Collection and Rubric-Guided Optimization
by: Su, Weihang, et al.
Published: (2026)

DRAGIN: Dynamic Retrieval Augmented Generation based on the Information Needs of Large Language Models
by: Su, Weihang, et al.
Published: (2024)

Dynamic and Parametric Retrieval-Augmented Generation
by: Su, Weihang, et al.
Published: (2025)

Analytical Search
by: Tu, Yiteng, et al.
Published: (2026)

Caseformer: Pre-training for Legal Case Retrieval Based on Inter-Case Distinctions
by: Su, Weihang, et al.
Published: (2023)

Enhancing LLM-Based Agents via Global Planning and Hierarchical Execution
by: Chen, Junjie, et al.
Published: (2025)

Parametric Social Identity Injection and Diversification in Public Opinion Simulation
by: Wang, Hexi, et al.
Published: (2026)

Beyond Exposure: Optimizing Ranking Fairness with Non-linear Time-Income Functions
by: Li, Xuancheng, et al.
Published: (2026)

Investigating Prosocial Behavior Theory in LLM Agents under Policy-Induced Inequities
by: Zhou, Yujia, et al.
Published: (2025)

Reinforcement Learning to Rank Using Coarse-grained Rewards
by: Tu, Yiteng, et al.
Published: (2022)

Parametric Retrieval Augmented Generation
by: Su, Weihang, et al.
Published: (2025)

Capability-aware Prompt Reformulation Learning for Text-to-Image Generation
by: Zhan, Jingtao, et al.
Published: (2024)

Simulating Dispute Mediation with LLM-Based Agents for Legal Research
by: Chen, Junjie, et al.
Published: (2025)

MemoryBench: A Benchmark for Memory and Continual Learning in LLM Systems
by: Ai, Qingyao, et al.
Published: (2025)

Mitigating Entity-Level Hallucination in Large Language Models
by: Su, Weihang, et al.
Published: (2024)

I^3 Retriever: Incorporating Implicit Interaction in Pre-trained Language Models for Passage Retrieval
by: Dong, Qian, et al.
Published: (2023)