Image de couverture de livre

Resolution Diagnostics for Paired LLM Evaluation

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Kotawala, Anany
Format:	Preprint
Publié:	2026
Sujets:	Computation and Language Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Locally Coherent, Globally Incoherent: Bounding Compositional Incoherence in Multi-Component LLM Agents
par: Kotawala, Anany
Publié: (2026)

GENSTRAT: Toward a Science of Strategic Reasoning in Large Language Models
par: Shadarevian, Vartan, et autres
Publié: (2026)

FairPair: A Robust Evaluation of Biases in Language Models through Paired Perturbations
par: Dwivedi-Yu, Jane, et autres
Publié: (2024)

An Explainable Diagnostic Framework for Neurodegenerative Dementias via Reinforcement-Optimized LLM Reasoning
par: Zamai, Andrew, et autres
Publié: (2025)

Evaluating Machine Translation Models for English-Hindi Language Pairs: A Comparative Analysis
par: Shetty, Ahan Prasannakumar
Publié: (2025)

Simulated Adoption: Decoupling Magnitude and Direction in LLM In-Context Conflict Resolution
par: Zhang, Long, et autres
Publié: (2026)

Evaluating Memory Structure in LLM Agents
par: Shutova, Alina, et autres
Publié: (2026)

LUME: LLM Unlearning with Multitask Evaluations
par: Ramakrishna, Anil, et autres
Publié: (2025)

Evaluating Judges as Evaluators: The JETTS Benchmark of LLM-as-Judges as Test-Time Scaling Evaluators
par: Zhou, Yilun, et autres
Publié: (2025)

A New Pair of GloVes
par: Carlson, Riley, et autres
Publié: (2025)

Pair2Score: Pairwise-to-Absolute Transfer for LLM-Based Essay Scoring
par: Hallaç, İbrahim Rıza, et autres
Publié: (2026)

SP^2DPO: An LLM-assisted Semantic Per-Pair DPO Generalization
par: He, Chaoyue, et autres
Publié: (2026)

Topic Identification in LLM Input-Output Pairs through the Lens of Information Bottleneck
par: Halperin, Igor
Publié: (2025)

Accelerating Unbiased LLM Evaluation via Synthetic Feedback
par: Zhou, Zhaoyi, et autres
Publié: (2025)

Explaining Length Bias in LLM-Based Preference Evaluations
par: Hu, Zhengyu, et autres
Publié: (2024)

Rethinking LLM Evaluation: Can We Evaluate LLMs with 200x Less Data?
par: Wang, Shaobo, et autres
Publié: (2025)

EffiPair: Improving the Efficiency of LLM-generated Code with Relative Contrastive Feedback
par: Hajizadeh, Samira, et autres
Publié: (2026)

Flying Pigs, FaR and Beyond: Evaluating LLM Reasoning in Counterfactual Worlds
par: Joishy, Anish R, et autres
Publié: (2025)

Who's Asking? Evaluating LLM Robustness to Inquiry Personas in Factual Question Answering
par: Akpinar, Nil-Jana, et autres
Publié: (2025)

On Evaluating LLM Alignment by Evaluating LLMs as Judges
par: Liu, Yixin, et autres
Publié: (2025)

How to Evaluate Entity Resolution Systems: An Entity-Centric Framework with Application to Inventor Name Disambiguation
par: Binette, Olivier, et autres
Publié: (2024)

Does Unlearning Truly Unlearn? A Black Box Evaluation of LLM Unlearning Methods
par: Doshi, Jai, et autres
Publié: (2024)

Evaluating LLM Story Generation through Large-scale Network Analysis of Social Structures
par: Nonaka, Hiroshi, et autres
Publié: (2025)

Low-resource Machine Translation for Code-switched Kazakh-Russian Language Pair
par: Borisov, Maksim, et autres
Publié: (2025)

How to Correctly Report LLM-as-a-Judge Evaluations
par: Lee, Chungpa, et autres
Publié: (2025)

NoteContrast: Contrastive Language-Diagnostic Pretraining for Medical Text
par: Kailas, Prajwal, et autres
Publié: (2024)

Mining Hidden Thoughts from Texts: Evaluating Continual Pretraining with Synthetic Data for LLM Reasoning
par: Ishibashi, Yoichi, et autres
Publié: (2025)

SWE-Adept: An LLM-Based Agentic Framework for Deep Codebase Analysis and Structured Issue Resolution
par: He, Kang, et autres
Publié: (2026)

Paired by the Teacher: Turning Unpaired Data into High-Fidelity Pairs for Low-Resource Text Generation
par: Lu, Yen-Ju, et autres
Publié: (2025)

Enhancing LLM Evaluations: The Garbling Trick
par: Bradley, William F.
Publié: (2024)

Survey on Evaluation of LLM-based Agents
par: Yehudai, Asaf, et autres
Publié: (2025)

Triplets Better Than Pairs: Towards Stable and Effective Self-Play Fine-Tuning for LLMs
par: Wang, Yibo, et autres
Publié: (2026)

From Token to Token Pair: Efficient Prompt Compression for Large Language Models in Clinical Prediction
par: Zhu, Mingcheng, et autres
Publié: (2026)

BioCoref: Benchmarking Biomedical Coreference Resolution with LLMs
par: Salem, Nourah M, et autres
Publié: (2025)

LLM Unlearning with LLM Beliefs
par: Li, Kemou, et autres
Publié: (2025)

Are LLM Evaluators Really Narcissists? Sanity Checking Self-Preference Evaluations
par: Roytburg, Dani, et autres
Publié: (2026)

Evaluating the Relevance of Uncertainty Estimators for LLM Hallucination
par: Agnimo, Yedidia, et autres
Publié: (2026)

Towards Multilingual LLM Evaluation for European Languages
par: Thellmann, Klaudia, et autres
Publié: (2024)

Code Comprehension then Auditing for Unsupervised LLM Evaluation
par: Patel, Bhrij, et autres
Publié: (2024)

Language Models over Canonical Byte-Pair Encodings
par: Vieira, Tim, et autres
Publié: (2025)