Aligning Human and LLM Judgments: Insights from EvalAssist on Task-Specific Evaluations and AI-assisted Assessment Strategy Preferences

Documenti analoghi

• EvalAssist: A Human-Centered Tool for LLM-as-a-Judge
  di: Ashktorab, Zahra, et al.
  Pubblicazione: (2025)
• Human-Centered Design Recommendations for LLM-as-a-Judge
  di: Pan, Qian, et al.
  Pubblicazione: (2024)
• Black-box Uncertainty Quantification Method for LLM-as-a-Judge
  di: Wagner, Nico, et al.
  Pubblicazione: (2024)
• Generate, Evaluate, Iterate: Synthetic Data for Human-in-the-Loop Refinement of LLM Judges
  di: Do, Hyo Jin, et al.
  Pubblicazione: (2025)
• MultEval: Supporting Collaborative Alignment for LLM-as-a-Judge Evaluation Criteria
  di: Chiang, Charles, et al.
  Pubblicazione: (2026)