Buchumschlag

SCORE: Systematic COnsistency and Robustness Evaluation for Large Language Models

Fuente: arXiv

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Nalbandyan, Grigor, Shahbazyan, Rima, Bakhturina, Evelina
Format:	Preprint
Veröffentlicht:	2025
Schlagworte:	Computation and Language
Online-Zugang:	Acceder al recurso
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Ähnliche Einträge

NeMo-Inspector: A Visualization Tool for LLM Generation Analysis
von: Gitman, Daria, et al.
Veröffentlicht: (2025)

CORD: Balancing COnsistency and Rank Distillation for Robust Retrieval-Augmented Generation
von: Lee, Youngwon, et al.
Veröffentlicht: (2024)

Retrieval meets Long Context Large Language Models
von: Xu, Peng, et al.
Veröffentlicht: (2023)

SCORE: Specificity, Context Utilization, Robustness, and Relevance for Reference-Free LLM Evaluation
von: Shomee, Homaira Huda, et al.
Veröffentlicht: (2026)

A Chat About Boring Problems: Studying GPT-based text normalization
von: Zhang, Yang, et al.
Veröffentlicht: (2023)

Mil-SCORE: Benchmarking Long-Context Geospatial Reasoning and Planning in Large Language Models
von: Palnitkar, Aadi, et al.
Veröffentlicht: (2026)

Representational Curvature Modulates Behavioral Uncertainty in Large Language Models
von: King, Jack, et al.
Veröffentlicht: (2026)

Community size rather than grammatical complexity better predicts Large Language Model accuracy in a novel Wug Test
von: Pantelidou, Nikoleta, et al.
Veröffentlicht: (2025)

A Proposed S.C.O.R.E. Evaluation Framework for Large Language Models : Safety, Consensus, Objectivity, Reproducibility and Explainability
von: Tan, Ting Fang, et al.
Veröffentlicht: (2024)

Language in Vivo vs. in Silico: Size Matters but Larger Language Models Still Do Not Comprehend Language on a Par with Humans Due to Impenetrable Semantic Reference
von: Dentella, Vittoria, et al.
Veröffentlicht: (2024)

A Systematic Evaluation of Large Language Models for Natural Language Generation Tasks
von: Ni, Xuanfan, et al.
Veröffentlicht: (2024)

Quantification and object perception in Multimodal Large Language Models and human linguistic cognition
von: Montero, Raquel, et al.
Veröffentlicht: (2025)

Understanding AI Evaluation Patterns: How Different GPT Models Assess Vision-Language Descriptions
von: Abdoli, Sajjad, et al.
Veröffentlicht: (2025)

Tracing the ongoing emergence of human-like reasoning in Large Language Models
von: Morosi, Paolo, et al.
Veröffentlicht: (2026)

Evaluating the Retrieval Robustness of Large Language Models
von: Cao, Shuyang, et al.
Veröffentlicht: (2025)

NEO-BENCH: Evaluating Robustness of Large Language Models with Neologisms
von: Zheng, Jonathan, et al.
Veröffentlicht: (2024)

AutoSCORE: Enhancing Automated Scoring with Multi-Agent Large Language Models via Structured Component Recognition
von: Wang, Yun, et al.
Veröffentlicht: (2025)

AURA: Affordance-Understanding and Risk-aware Alignment Technique for Large Language Models
von: Adak, Sayantan, et al.
Veröffentlicht: (2025)

Large Language Model probabilities cannot distinguish between possible and impossible language
von: Leivada, Evelina, et al.
Veröffentlicht: (2025)

SafeInfer: Context Adaptive Decoding Time Safety Alignment for Large Language Models
von: Banerjee, Somnath, et al.
Veröffentlicht: (2024)

Systematic Evaluation of Uncertainty Estimation Methods in Large Language Models
von: Hobelsberger, Christian, et al.
Veröffentlicht: (2025)

Evaluating Robustness of Large Language Models Against Multilingual Typographical Errors
von: Zhao, Raoyuan, et al.
Veröffentlicht: (2025)

Speaker Tagging Correction With Non-Autoregressive Language Models
von: Kirakosyan, Grigor, et al.
Veröffentlicht: (2024)

A Sentence is Worth a Thousand Pictures: Can Large Language Models Understand Hum4n L4ngu4ge and the W0rld behind W0rds?
von: Leivada, Evelina, et al.
Veröffentlicht: (2023)

MathRobust-LV: Evaluation of Large Language Models' Robustness to Linguistic Variations in Mathematical Reasoning
von: Kirtane, Neeraja, et al.
Veröffentlicht: (2025)

SCORE: A Semantic Evaluation Framework for Generative Document Parsing
von: Li, Renyu, et al.
Veröffentlicht: (2025)

S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Models
von: Lei, Fangyu, et al.
Veröffentlicht: (2023)

Evaluating Robustness of Large Audio Language Models to Audio Injection: An Empirical Study
von: Hou, Guanyu, et al.
Veröffentlicht: (2025)

RUPBench: Benchmarking Reasoning Under Perturbations for Robustness Evaluation in Large Language Models
von: Wang, Yuqing, et al.
Veröffentlicht: (2024)

Sowing the Wind, Reaping the Whirlwind: The Impact of Editing Language Models
von: Hazra, Rima, et al.
Veröffentlicht: (2024)

A Systematic Review on the Evaluation of Large Language Models in Theory of Mind Tasks
von: Sarıtaş, Karahan, et al.
Veröffentlicht: (2025)

Enabling Inclusive Systematic Reviews: Incorporating Preprint Articles with Large Language Model-Driven Evaluations
von: Yang, Rui, et al.
Veröffentlicht: (2025)

LLMEval-Fair: A Large-Scale Longitudinal Study on Robust and Fair Evaluation of Large Language Models
von: Zhang, Ming, et al.
Veröffentlicht: (2025)

On the Robustness of Editing Large Language Models
von: Ma, Xinbei, et al.
Veröffentlicht: (2024)

Lexicon-Level Contrastive Visual-Grounding Improves Language Modeling
von: Zhuang, Chengxu, et al.
Veröffentlicht: (2024)

Evaluating the Robustness of Analogical Reasoning in Large Language Models
von: Lewis, Martha, et al.
Veröffentlicht: (2024)

Systematic Weight Evaluation for Pruning Large Language Models: Enhancing Performance and Sustainability
von: Islam, Ashhadul, et al.
Veröffentlicht: (2025)

A Systematic Evaluation of Large Language Models for PTSD Severity Estimation: The Role of Contextual Knowledge and Modeling Strategies
von: Kaliosis, Panagiotis, et al.
Veröffentlicht: (2026)

FLEX: A Benchmark for Evaluating Robustness of Fairness in Large Language Models
von: Jung, Dahyun, et al.
Veröffentlicht: (2025)

Evaluating Large Language Models for Generalization and Robustness via Data Compression
von: Li, Yucheng, et al.
Veröffentlicht: (2024)