Image de couverture de livre

CompassJudger-1: All-in-one Judge Model Helps Model Evaluation and Evolution

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Cao, Maosong, Lam, Alexander, Duan, Haodong, Liu, Hongwei, Zhang, Songyang, Chen, Kai
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

CompassJudger-2: Towards Generalist Judge Model via Verifiable Rewards
par: Zhang, Taolin, et autres
Publié: (2025)

CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and Outcome Reward
par: Liu, Shudong, et autres
Publié: (2025)

Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement
par: Cao, Maosong, et autres
Publié: (2025)

Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks
par: Wang, Chonghua, et autres
Publié: (2024)

Coding Triangle: How Does Large Language Model Understand Code?
par: Zhang, Taolin, et autres
Publié: (2025)

Rectifying LLM Thought from Lens of Optimization
par: Liu, Junnan, et autres
Publié: (2025)

Judge Before Answer: Can MLLM Discern the False Premise in Question?
par: Li, Jidong, et autres
Publié: (2025)

Are Your LLMs Capable of Stable Reasoning?
par: Liu, Junnan, et autres
Publié: (2024)

Debate Helps Weak Judges Reward Stronger Models
par: Elasky, Ethan, et autres
Publié: (2026)

Fixing the Broken Compass: Diagnosing and Improving Inference-Time Reward Modeling
par: Li, Jiachun, et autres
Publié: (2025)

Dissecting Tool-Integrated Reasoning: An Empirical Study and Analysis
par: Zhao, Yufeng, et autres
Publié: (2025)

Deciphering Trajectory-Aided LLM Reasoning: An Optimization Perspective
par: Liu, Junnan, et autres
Publié: (2025)

Graphs of Research: Citation Evolution Graphs as Supervision for Research Idea Generation
par: Gao, Songyang, et autres
Publié: (2026)

JudgeLRM: Large Reasoning Models as a Judge
par: Chen, Nuo, et autres
Publié: (2025)

Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges
par: Thakur, Aman Singh, et autres
Publié: (2024)

Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models
par: Röttger, Paul, et autres
Publié: (2024)

Open Source Language Models Can Provide Feedback: Evaluating LLMs' Ability to Help Students Using GPT-4-As-A-Judge
par: Koutcheme, Charles, et autres
Publié: (2024)

JudgeBoard: Benchmarking and Enhancing Small Language Models for Reasoning Evaluation
par: Bi, Zhenyu, et autres
Publié: (2025)

AgentCompass: Towards Reliable Evaluation of Agentic Workflows in Production
par: Kartik, NVJK, et autres
Publié: (2025)

OpenCompass: A Universal Evaluation Platform for Large Language Models
par: Cao, Maosong, et autres
Publié: (2026)

When Long Helps Short: How Context Length in Supervised Fine-tuning Affects Behavior of Large Language Models
par: Zheng, Yingming, et autres
Publié: (2025)

Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models
par: Verga, Pat, et autres
Publié: (2024)

JudgeLM: Fine-tuned Large Language Models are Scalable Judges
par: Zhu, Lianghui, et autres
Publié: (2023)

On Evaluating LLM Alignment by Evaluating LLMs as Judges
par: Liu, Yixin, et autres
Publié: (2025)

Empirical Analysis of Decoding Biases in Masked Diffusion Models
par: Huang, Pengcheng, et autres
Publié: (2025)

Mixed Distillation Helps Smaller Language Model Better Reasoning
par: Li, Chenglin, et autres
Publié: (2023)

CLASH: Evaluating Language Models on Judging High-Stakes Dilemmas from Multiple Perspectives
par: Lee, Ayoung, et autres
Publié: (2025)

Runaway is Ashamed, But Helpful: On the Early-Exit Behavior of Large Language Model-based Agents in Embodied Environments
par: Lu, Qingyu, et autres
Publié: (2025)

DiffusionDialog: A Diffusion Model for Diverse Dialog Generation with Latent Space
par: Xiang, Jianxiang, et autres
Publié: (2024)

Can Small Language Models Help Large Language Models Reason Better?: LM-Guided Chain-of-Thought
par: Lee, Jooyoung, et autres
Publié: (2024)

Permutation-Consensus Listwise Judging for Robust Factuality Evaluation
par: Huang, Tianyi, et autres
Publié: (2026)

DiffScore: Text Evaluation Beyond Autoregressive Likelihood
par: Lai, Wen, et autres
Publié: (2026)

FoundaBench: Evaluating Chinese Fundamental Knowledge Capabilities of Large Language Models
par: Li, Wei, et autres
Publié: (2024)

Evaluating Metrics for Safety with LLM-as-Judges
par: Clegg, Kester, et autres
Publié: (2025)

HonestLLM: Toward an Honest and Helpful Large Language Model
par: Gao, Chujie, et autres
Publié: (2024)

StrucText-Eval: Evaluating Large Language Model's Reasoning Ability in Structure-Rich Text
par: Gu, Zhouhong, et autres
Publié: (2024)

Can Reasoning Help Large Language Models Capture Human Annotator Disagreement?
par: Ni, Jingwei, et autres
Publié: (2025)

A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules
par: Luo, Kairong, et autres
Publié: (2025)

On the Essence and Prospect: An Investigation of Alignment Approaches for Big Models
par: Wang, Xinpeng, et autres
Publié: (2024)

Rho-1: Not All Tokens Are What You Need
par: Lin, Zhenghao, et autres
Publié: (2024)