Sentence-level Aggregation of Lexical Metrics Correlates Stronger with Human Judgements than Corpus-level Aggregation

Documenti analoghi

• Exploring Performance Variations in Finetuned Translators of Ultra-Low Resource Languages: Do Linguistic Differences Matter?
  di: Gonçalves, Isabel, et al.
  Pubblicazione: (2025)
• CAT: A Metric-Driven Framework for Analyzing the Consistency-Accuracy Relation of LLMs under Controlled Input Variations
  di: Cavalin, Paulo, et al.
  Pubblicazione: (2025)
• Improving Score Reliability of Multiple Choice Benchmarks with Consistency Evaluation and Altered Answer Choices
  di: Cavalin, Paulo, et al.
  Pubblicazione: (2025)
• The Non-Determinism of Small LLMs: Evidence of Low Answer Consistency in Repetition Trials of Standard Multiple-Choice Benchmarks
  di: Pinhanez, Claudio, et al.
  Pubblicazione: (2025)
• Computational Sentence-level Metrics Predicting Human Sentence Comprehension
  di: Sun, Kun, et al.
  Pubblicazione: (2024)