LLM Judges Inconsistently Disagree Across Safety Criteria and Harm Categories
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2026
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866910272411664384 |
|---|---|
| author | Vishnubhotla, Krishnapriya Vajjala, Soumya Vij, Akriti Nejadgholi, Isar |
| author_facet | Vishnubhotla, Krishnapriya Vajjala, Soumya Vij, Akriti Nejadgholi, Isar |
| contents | We evaluate the consistency of automated judges in conducting a multi-dimensional safety evaluation in a reference-free setup. Our results indicate that Large Language Models are unreliable judges in identifying safety issues related to machine-generated advice in regulated domains such as finance, although they are more reliable at identifying more overt forms of unsafe/harmful content such as violence. The degree of inconsistency in a model's judgments can vary significantly by the chosen safety criteria and can be impacted by the language of the content and its linguistic style as well. Finally, there is high disagreement among different judges for the same output, across domains, safety criteria, and languages. These findings provide new insights on the practice of using LLMs as evaluators and offer several recommendations for practitioners on how to use automated judges in practical scenarios. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_31381 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | LLM Judges Inconsistently Disagree Across Safety Criteria and Harm Categories Vishnubhotla, Krishnapriya Vajjala, Soumya Vij, Akriti Nejadgholi, Isar Computation and Language We evaluate the consistency of automated judges in conducting a multi-dimensional safety evaluation in a reference-free setup. Our results indicate that Large Language Models are unreliable judges in identifying safety issues related to machine-generated advice in regulated domains such as finance, although they are more reliable at identifying more overt forms of unsafe/harmful content such as violence. The degree of inconsistency in a model's judgments can vary significantly by the chosen safety criteria and can be impacted by the language of the content and its linguistic style as well. Finally, there is high disagreement among different judges for the same output, across domains, safety criteria, and languages. These findings provide new insights on the practice of using LLMs as evaluators and offer several recommendations for practitioners on how to use automated judges in practical scenarios. |
| title | LLM Judges Inconsistently Disagree Across Safety Criteria and Harm Categories |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2605.31381 |