Copertina

CompassJudger-1: All-in-one Judge Model Helps Model Evaluation and Evolution

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Cao, Maosong, Lam, Alexander, Duan, Haodong, Liu, Hongwei, Zhang, Songyang, Chen, Kai
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

CompassJudger-2: Towards Generalist Judge Model via Verifiable Rewards
di: Zhang, Taolin, et al.
Pubblicazione: (2025)

CompassVerifier: A Unified and Robust Verifier for LLMs Evaluation and Outcome Reward
di: Liu, Shudong, et al.
Pubblicazione: (2025)

Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement
di: Cao, Maosong, et al.
Pubblicazione: (2025)

Ada-LEval: Evaluating long-context LLMs with length-adaptable benchmarks
di: Wang, Chonghua, et al.
Pubblicazione: (2024)

Coding Triangle: How Does Large Language Model Understand Code?
di: Zhang, Taolin, et al.
Pubblicazione: (2025)

Rectifying LLM Thought from Lens of Optimization
di: Liu, Junnan, et al.
Pubblicazione: (2025)

Judge Before Answer: Can MLLM Discern the False Premise in Question?
di: Li, Jidong, et al.
Pubblicazione: (2025)

Are Your LLMs Capable of Stable Reasoning?
di: Liu, Junnan, et al.
Pubblicazione: (2024)

Debate Helps Weak Judges Reward Stronger Models
di: Elasky, Ethan, et al.
Pubblicazione: (2026)

Fixing the Broken Compass: Diagnosing and Improving Inference-Time Reward Modeling
di: Li, Jiachun, et al.
Pubblicazione: (2025)

Dissecting Tool-Integrated Reasoning: An Empirical Study and Analysis
di: Zhao, Yufeng, et al.
Pubblicazione: (2025)

Deciphering Trajectory-Aided LLM Reasoning: An Optimization Perspective
di: Liu, Junnan, et al.
Pubblicazione: (2025)

Graphs of Research: Citation Evolution Graphs as Supervision for Research Idea Generation
di: Gao, Songyang, et al.
Pubblicazione: (2026)

JudgeLRM: Large Reasoning Models as a Judge
di: Chen, Nuo, et al.
Pubblicazione: (2025)

Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges
di: Thakur, Aman Singh, et al.
Pubblicazione: (2024)

Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models
di: Röttger, Paul, et al.
Pubblicazione: (2024)

Open Source Language Models Can Provide Feedback: Evaluating LLMs' Ability to Help Students Using GPT-4-As-A-Judge
di: Koutcheme, Charles, et al.
Pubblicazione: (2024)

JudgeBoard: Benchmarking and Enhancing Small Language Models for Reasoning Evaluation
di: Bi, Zhenyu, et al.
Pubblicazione: (2025)

AgentCompass: Towards Reliable Evaluation of Agentic Workflows in Production
di: Kartik, NVJK, et al.
Pubblicazione: (2025)

OpenCompass: A Universal Evaluation Platform for Large Language Models
di: Cao, Maosong, et al.
Pubblicazione: (2026)

When Long Helps Short: How Context Length in Supervised Fine-tuning Affects Behavior of Large Language Models
di: Zheng, Yingming, et al.
Pubblicazione: (2025)

Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models
di: Verga, Pat, et al.
Pubblicazione: (2024)

JudgeLM: Fine-tuned Large Language Models are Scalable Judges
di: Zhu, Lianghui, et al.
Pubblicazione: (2023)

On Evaluating LLM Alignment by Evaluating LLMs as Judges
di: Liu, Yixin, et al.
Pubblicazione: (2025)

Empirical Analysis of Decoding Biases in Masked Diffusion Models
di: Huang, Pengcheng, et al.
Pubblicazione: (2025)

Mixed Distillation Helps Smaller Language Model Better Reasoning
di: Li, Chenglin, et al.
Pubblicazione: (2023)

CLASH: Evaluating Language Models on Judging High-Stakes Dilemmas from Multiple Perspectives
di: Lee, Ayoung, et al.
Pubblicazione: (2025)

Runaway is Ashamed, But Helpful: On the Early-Exit Behavior of Large Language Model-based Agents in Embodied Environments
di: Lu, Qingyu, et al.
Pubblicazione: (2025)

DiffusionDialog: A Diffusion Model for Diverse Dialog Generation with Latent Space
di: Xiang, Jianxiang, et al.
Pubblicazione: (2024)

Can Small Language Models Help Large Language Models Reason Better?: LM-Guided Chain-of-Thought
di: Lee, Jooyoung, et al.
Pubblicazione: (2024)

Permutation-Consensus Listwise Judging for Robust Factuality Evaluation
di: Huang, Tianyi, et al.
Pubblicazione: (2026)

DiffScore: Text Evaluation Beyond Autoregressive Likelihood
di: Lai, Wen, et al.
Pubblicazione: (2026)

FoundaBench: Evaluating Chinese Fundamental Knowledge Capabilities of Large Language Models
di: Li, Wei, et al.
Pubblicazione: (2024)

Evaluating Metrics for Safety with LLM-as-Judges
di: Clegg, Kester, et al.
Pubblicazione: (2025)

HonestLLM: Toward an Honest and Helpful Large Language Model
di: Gao, Chujie, et al.
Pubblicazione: (2024)

StrucText-Eval: Evaluating Large Language Model's Reasoning Ability in Structure-Rich Text
di: Gu, Zhouhong, et al.
Pubblicazione: (2024)

Can Reasoning Help Large Language Models Capture Human Annotator Disagreement?
di: Ni, Jingwei, et al.
Pubblicazione: (2025)

A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules
di: Luo, Kairong, et al.
Pubblicazione: (2025)

On the Essence and Prospect: An Investigation of Alignment Approaches for Big Models
di: Wang, Xinpeng, et al.
Pubblicazione: (2024)

Rho-1: Not All Tokens Are What You Need
di: Lin, Zhenghao, et al.
Pubblicazione: (2024)