Copertina

A Fixed-Budget, Cluster-Aware Standard for LLM-as-a-Judge Evaluation: A Multi-Hop RAG Stress Test

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Sartori, Camilo Chacón, García, José H.
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Artificial Intelligence Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Replace, Don't Expand: Mitigating Context Dilution in Multi-Hop RAG via Fixed-Budget Evidence Assembly
di: Lahmy, Moshe, et al.
Pubblicazione: (2025)

Architectures of Error: A Philosophical Inquiry into AI and Human Code Generation
di: Sartori, Camilo Chacón
Pubblicazione: (2025)

Case-Aware LLM-as-a-Judge Evaluation for Enterprise-Scale RAG Systems
di: Chhabra, Mukul, et al.
Pubblicazione: (2026)

Multi-Meta-RAG: Improving RAG for Multi-Hop Queries using Database Filtering with LLM-Extracted Metadata
di: Poliakov, Mykhailo, et al.
Pubblicazione: (2024)

CompactRAG: Reducing LLM Calls and Token Overhead in Multi-Hop Question Answering
di: Yang, Hao, et al.
Pubblicazione: (2026)

Combinatorial Optimization for All: Using LLMs to Aid Non-Experts in Improving Optimization Algorithms
di: Sartori, Camilo Chacón, et al.
Pubblicazione: (2025)

EfficientRAG: Efficient Retriever for Multi-Hop Question Answering
di: Zhuang, Ziyuan, et al.
Pubblicazione: (2024)

CCRS: A Zero-Shot LLM-as-a-Judge Framework for Comprehensive RAG Evaluation
di: Muhamed, Aashiq
Pubblicazione: (2025)

Credible Plan-Driven RAG Method for Multi-Hop Question Answering
di: Zhang, Ningning, et al.
Pubblicazione: (2025)

LLM-Based Instance-Driven Heuristic Bias In the Context of a Biased Random Key Genetic Algorithm
di: Sartori, Camilo Chacón, et al.
Pubblicazione: (2025)

A Scaling Law for Token Efficiency in LLM Fine-Tuning Under Fixed Compute Budgets
di: Lagasse, Ryan, et al.
Pubblicazione: (2025)

Inference Scaled GraphRAG: Improving Multi Hop Question Answering on Knowledge Graphs
di: Thompson, Travis, et al.
Pubblicazione: (2025)

Support Evaluation for the TREC 2024 RAG Track: Comparing Human versus LLM Judges
di: Thakur, Nandan, et al.
Pubblicazione: (2025)

Evaluating Metrics for Safety with LLM-as-Judges
di: Clegg, Kester, et al.
Pubblicazione: (2025)

Coherent Without Grounding, Grounded Without Success: Observability and Epistemic Failure
di: Sartori, Camilo Chacón
Pubblicazione: (2026)

JudgeBench: A Benchmark for Evaluating LLM-based Judges
di: Tan, Sijun, et al.
Pubblicazione: (2024)

In-Situ Behavioral Evaluation for LLM Fairness, Not Standardized-Test Scores
di: Tang, Zeyu, et al.
Pubblicazione: (2026)

VisGraphVar: A Benchmark Generator for Assessing Variability in Graph Analysis Using Large Vision-Language Models
di: Sartori, Camilo Chacón, et al.
Pubblicazione: (2024)

BAGEN: Are LLM Agents Budget-Aware?
di: Lin, Yuxiang, et al.
Pubblicazione: (2026)

Token-Budget-Aware LLM Reasoning
di: Han, Tingxu, et al.
Pubblicazione: (2024)

MedHopQA: A Disease-Centered Multi-Hop Reasoning Benchmark and Evaluation Framework for LLM-Based Biomedical Question Answering
di: Islamaj, Rezarta, et al.
Pubblicazione: (2026)

S-Path-RAG: Semantic-Aware Shortest-Path Retrieval Augmented Generation for Multi-Hop Knowledge Graph Question Answering
di: Fu, Rong, et al.
Pubblicazione: (2026)

Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judge
di: Shi, Lin, et al.
Pubblicazione: (2024)

R-Judge: Benchmarking Safety Risk Awareness for LLM Agents
di: Yuan, Tongxin, et al.
Pubblicazione: (2024)

VERT: Reliable LLM Judges for Radiology Report Evaluation
di: Bologna, Federica, et al.
Pubblicazione: (2026)

JuICE: A Benchmark for Evaluating LLM-Judge in Identifying Cultural Errors
di: Jin, Jiho, et al.
Pubblicazione: (2026)

Aligning Tree-Search Policies with Fixed Token Budgets in Test-Time Scaling of LLMs
di: Miyamoto, Sora, et al.
Pubblicazione: (2026)

A Survey on LLM-as-a-Judge
di: Gu, Jiawei, et al.
Pubblicazione: (2024)

Improving Existing Optimization Algorithms with LLMs
di: Sartori, Camilo Chacón, et al.
Pubblicazione: (2025)

Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges
di: Thakur, Aman Singh, et al.
Pubblicazione: (2024)

On Evaluating LLM Alignment by Evaluating LLMs as Judges
di: Liu, Yixin, et al.
Pubblicazione: (2025)

Learning to Plan & Reason for Evaluation with Thinking-LLM-as-a-Judge
di: Saha, Swarnadeep, et al.
Pubblicazione: (2025)

M-Prometheus: A Suite of Open Multilingual LLM Judges
di: Pombal, José, et al.
Pubblicazione: (2025)

LeMAJ (Legal LLM-as-a-Judge): Bridging Legal Reasoning and LLM Evaluation
di: Enguehard, Joseph, et al.
Pubblicazione: (2025)

An Analysis of Decoding Methods for LLM-based Agents for Faithful Multi-Hop Question Answering
di: Murphy, Alexander, et al.
Pubblicazione: (2025)

Judge's Verdict: A Comprehensive Analysis of LLM Judge Capability Through Human Agreement
di: Han, Steve, et al.
Pubblicazione: (2025)

AdaGReS:Adaptive Greedy Context Selection via Redundancy-Aware Scoring for Token-Budgeted RAG
di: Peng, Chao, et al.
Pubblicazione: (2025)

SuperRAG: Beyond RAG with Layout-Aware Graph Modeling
di: Yang, Jeff, et al.
Pubblicazione: (2025)

Steering LLM Thinking with Budget Guidance
di: Li, Junyan, et al.
Pubblicazione: (2025)

BERT-as-a-Judge: A Robust Alternative to Lexical Methods for Efficient Reference-Based LLM Evaluation
di: Gisserot-Boukhlef, Hippolyte, et al.
Pubblicazione: (2026)