Cover Image

EQUATOR: A Deterministic Framework for Evaluating LLM Reasoning with Open-Ended Questions. # v1.0.0-beta

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bernard, Raymond, Raza, Shaina, Das, Subhabrata, Murugan, Rahul
Format:	Preprint
Published:	2024
Subjects:	Computation and Language 68T20 I.2.7; I.2.6; H.3.3
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LLM Reasoning for Cold-Start Item Recommendation
by: Li, Shijun, et al.
Published: (2025)

LLM-as-a-Judge: Rapid Evaluation of Legal Document Recommendation for Retrieval-Augmented Generation
by: Pradhan, Anu, et al.
Published: (2025)

What Matters in LLM-Based Feature Extractor for Recommender? A Systematic Analysis of Prompts, Models, and Adaptation
by: Shi, Kainan, et al.
Published: (2025)

EdgeJury: Cross-Reviewed Small-Model Ensembles for Truthful Question Answering on Serverless Edge Inference
by: Kumar, Aayush
Published: (2025)

FinQAPT: Empowering Financial Decisions with End-to-End LLM-driven Question Answering Pipeline
by: Singh, Kuldeep, et al.
Published: (2024)

Optimizing Retrieval-Augmented Generation (RAG) for Colloquial Cantonese: A LoRA-Based Systematic Review
by: Calonge, David Santandreu, et al.
Published: (2025)

Evolve: A Persistent Knowledge Lifecycle for Small Language Models
by: Hovagimian, Dikran
Published: (2026)

Qtok: A Comprehensive Framework for Evaluating Multilingual Tokenizer Quality in Large Language Models
by: Chelombitko, Iaroslav, et al.
Published: (2024)

MoVoC: Morphology-Aware Subword Construction for Geez Script Languages
by: Teklehaymanot, Hailay Kidu, et al.
Published: (2025)

BudgetMem: Learning Selective Memory Policies for Cost-Efficient Long-Context Processing in Language Models
by: Alla, Chandra Vamsi Krishna, et al.
Published: (2025)

MODP: Multi Objective Directional Prompting
by: Nema, Aashutosh, et al.
Published: (2025)

RouteNLP: Closed-Loop LLM Routing with Conformal Cascading and Distillation Co-Optimization
by: Guo, Dongxin, et al.
Published: (2026)

PubMed Reasoner: Dynamic Reasoning-based Retrieval for Evidence-Grounded Biomedical Question Answering
by: Zhang, Yiqing, et al.
Published: (2026)

Experimentation Accelerator: Interpretable Insights and Creative Recommendations for A/B Testing with Content-Aware ranking
by: Hu, Zhengmian, et al.
Published: (2026)

ComplianceNLP: Knowledge-Graph-Augmented RAG for Multi-Framework Regulatory Gap Detection
by: Guo, Dongxin, et al.
Published: (2026)

DeformAr: Rethinking NER Evaluation through Component Analysis and Visual Analytics
by: Younes, Ahmed Mustafa
Published: (2025)

Learning to Detect Relevant Contexts and Knowledge for Response Selection in Retrieval-based Dialogue Systems
by: Hua, Kai, et al.
Published: (2025)

Improving the Performance of Sequential Recommendation Systems with an Extended Large Language Model
by: Choi, Sinnyum, et al.
Published: (2025)

PatenTEB: A Comprehensive Benchmark and Model Family for Patent Text Embedding
by: Ayaou, Iliass, et al.
Published: (2025)

Real-Time RAG for the Identification of Supply Chain Vulnerabilities
by: Ponnock, Jesse, et al.
Published: (2025)

RACE-Align: Retrieval-Augmented and Chain-of-Thought Enhanced Preference Alignment for Large Language Models
by: Yan, Qihang, et al.
Published: (2025)

Mind the Gap: A Generalized Approach for Cross-Modal Embedding Alignment
by: Yadav, Arihan, et al.
Published: (2024)

Combating data scarcity in recommendation services: Integrating cognitive types of VARK and neural network technologies (LLM)
by: Zmanovskii, Nikita
Published: (2026)

Learning When to Remember: Risk-Sensitive Contextual Bandits for Abstention-Aware Memory Retrieval in LLM-Based Coding Agents
by: Iscan, Mehmet
Published: (2026)

Retrieval Augmented Classification for Confidential Documents
by: Chang, Yeseul E., et al.
Published: (2026)

NameBERT: Scaling Name-Based Nationality Classification with LLM-Augmented Open Academic Data
by: Ming, Cong, et al.
Published: (2026)

IMDMR: An Intelligent Multi-Dimensional Memory Retrieval System for Enhanced Conversational AI
by: Pawar, Tejas, et al.
Published: (2025)

NSFL: A Post-Training Neuro-Symbolic Fuzzy Logic Framework for Boolean Operators in Neural Embeddings
by: Vexler, Vladi, et al.
Published: (2026)

Retrieval Augmented Thought Process for Private Data Handling in Healthcare
by: Pouplin, Thomas, et al.
Published: (2024)

Steering Conceptual Bias via Transformer Latent-Subspace Activation
by: Sharma, Vansh, et al.
Published: (2025)

TrueReason: An Exemplar Personalised Learning System Integrating Reasoning with Foundational Models
by: Bulathwela, Sahan, et al.
Published: (2025)

PRISM: LLM-Guided Semantic Clustering for High-Precision Topics
by: Douglas, Connor, et al.
Published: (2026)

ChronoMedKG: A Temporally-Grounded Biomedical Knowledge Graph and Benchmark for Clinical Reasoning
by: Ahmed, Md Shamim, et al.
Published: (2026)

Towards Adaptive Context Management for Intelligent Conversational Question Answering
by: Perera, Manoj Madushanka, et al.
Published: (2025)

Contextually Aware E-Commerce Product Question Answering using RAG
by: Tangarajan, Praveen, et al.
Published: (2025)

Biomedical systems biology workflow orchestration and execution with PoSyMed
by: Süwer, Simon, et al.
Published: (2026)

Conversational No-code, Multi-agentic Disease Module Identification and Drug Repurposing Prediction with ChatDRex
by: Süwer, Simon, et al.
Published: (2025)

Tulip Agent -- Enabling LLM-Based Agents to Solve Tasks Using Large Tool Libraries
by: Ocker, Felix, et al.
Published: (2024)

A Comparative Study of Language Models for Khmer Retrieval-Augmented Question Answering
by: Ros, Sereiwathna, et al.
Published: (2026)

Utilizing Large Language Models to Synthesize Product Desirability Datasets
by: Hastings, John D., et al.
Published: (2024)