THELMA: Task Based Holistic Evaluation of Large Language Model Applications-RAG Question Answering
Fuente:
arXiv
Guardado en:
| Autores principales: | Patel, Udita, Mulkar, Rutu, Roberts, Jay, Senthilkumar, Cibi Chakravarthy, Gandhi, Sujay, Zheng, Xiaofei, Nayyar, Naumaan, Kalra, Parul, Castrillo, Rafael |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Mind the Goal: Data-Efficient Goal-Oriented Evaluation of Conversational Agents and Chatbots using Teacher Models
por: Piskala, Deepak Babu, et al.
Publicado: (2025)
por: Piskala, Deepak Babu, et al.
Publicado: (2025)
Reconciling Methodological Paradigms: Employing Large Language Models as Novice Qualitative Research Assistants in Talent Management Research
por: Bhaduri, Sreyoshi, et al.
Publicado: (2024)
por: Bhaduri, Sreyoshi, et al.
Publicado: (2024)
Qualitative Insights Tool (QualIT): LLM Enhanced Topic Modeling
por: Kapoor, Satya, et al.
Publicado: (2024)
por: Kapoor, Satya, et al.
Publicado: (2024)
MultiFinRAG: An Optimized Multimodal Retrieval-Augmented Generation (RAG) Framework for Financial Question Answering
por: Gondhalekar, Chinmay, et al.
Publicado: (2025)
por: Gondhalekar, Chinmay, et al.
Publicado: (2025)
Assessment of RAG and Fine-Tuning for Industrial Question-Answering-Applications
por: Sturm, Jakob, et al.
Publicado: (2026)
por: Sturm, Jakob, et al.
Publicado: (2026)
HR-MultiWOZ: A Task Oriented Dialogue (TOD) Dataset for HR LLM Agent
por: Xu, Weijie, et al.
Publicado: (2024)
por: Xu, Weijie, et al.
Publicado: (2024)
Bisecting K-Means in RAG for Enhancing Question-Answering Tasks Performance in Telecommunications
por: Sousa, Pedro, et al.
Publicado: (2025)
por: Sousa, Pedro, et al.
Publicado: (2025)
Structured RAG for Answering Aggregative Questions
por: Koshorek, Omri, et al.
Publicado: (2025)
por: Koshorek, Omri, et al.
Publicado: (2025)
From RAG to Agentic RAG for Faithful Islamic Question Answering
por: Bhatia, Gagan, et al.
Publicado: (2026)
por: Bhatia, Gagan, et al.
Publicado: (2026)
Neon: News Entity-Interaction Extraction for Enhanced Question Answering
por: Singhania, Sneha, et al.
Publicado: (2024)
por: Singhania, Sneha, et al.
Publicado: (2024)
Role of crosslinkers on the properties of bio‐based wood adhesives
por: Pratik Patel, et al.
Publicado: (2024)
por: Pratik Patel, et al.
Publicado: (2024)
SemRAG: Semantic Knowledge-Augmented RAG for Improved Question-Answering
por: Zhong, Kezhen, et al.
Publicado: (2025)
por: Zhong, Kezhen, et al.
Publicado: (2025)
CoDi: Conversational Distillation for Grounded Question Answering
por: Huber, Patrick, et al.
Publicado: (2024)
por: Huber, Patrick, et al.
Publicado: (2024)
AccurateRAG: A Framework for Building Accurate Retrieval-Augmented Question-Answering Applications
por: Nguyen, Linh The, et al.
Publicado: (2025)
por: Nguyen, Linh The, et al.
Publicado: (2025)
AURA Score: A Metric For Holistic Audio Question Answering Evaluation
por: Dixit, Satvik, et al.
Publicado: (2025)
por: Dixit, Satvik, et al.
Publicado: (2025)
Augmenting Question Answering with A Hybrid RAG Approach
por: Yang, Tianyi, et al.
Publicado: (2026)
por: Yang, Tianyi, et al.
Publicado: (2026)
Reading Between the Timelines: RAG for Answering Diachronic Questions
por: Lau, Kwun Hang, et al.
Publicado: (2025)
por: Lau, Kwun Hang, et al.
Publicado: (2025)
MultiCube-RAG for Multi-hop Question Answering
por: Shi, Jimeng, et al.
Publicado: (2026)
por: Shi, Jimeng, et al.
Publicado: (2026)
Evaluation of RAG Metrics for Question Answering in the Telecom Domain
por: Roychowdhury, Sujoy, et al.
Publicado: (2024)
por: Roychowdhury, Sujoy, et al.
Publicado: (2024)
MedCoT-RAG: Causal Chain-of-Thought RAG for Medical Question Answering
por: Wang, Ziyu, et al.
Publicado: (2025)
por: Wang, Ziyu, et al.
Publicado: (2025)
Comparing RAG and GraphRAG for Page-Level Retrieval Question Answering on Math Textbook
por: Chen, Eason, et al.
Publicado: (2025)
por: Chen, Eason, et al.
Publicado: (2025)
W-RAG: Weakly Supervised Dense Retrieval in RAG for Open-domain Question Answering
por: Nian, Jinming, et al.
Publicado: (2024)
por: Nian, Jinming, et al.
Publicado: (2024)
VQA-Levels: A Hierarchical Approach for Classifying Questions in VQA
por: Madaka, Madhuri Latha, et al.
Publicado: (2025)
por: Madaka, Madhuri Latha, et al.
Publicado: (2025)
Ontology-Aware RAG for Improved Question-Answering in Cybersecurity Education
por: Zhao, Chengshuai, et al.
Publicado: (2024)
por: Zhao, Chengshuai, et al.
Publicado: (2024)
Chronological Passage Assembling in RAG framework for Temporal Question Answering
por: Kim, Byeongjeong, et al.
Publicado: (2025)
por: Kim, Byeongjeong, et al.
Publicado: (2025)
A Graph-based RAG for Energy Efficiency Question Answering
por: Campi, Riccardo, et al.
Publicado: (2025)
por: Campi, Riccardo, et al.
Publicado: (2025)
FARSIQA: Faithful and Advanced RAG System for Islamic Question Answering
por: Asl, Mohammad Aghajani, et al.
Publicado: (2025)
por: Asl, Mohammad Aghajani, et al.
Publicado: (2025)
RAG-based Question Answering over Heterogeneous Data and Text
por: Christmann, Philipp, et al.
Publicado: (2024)
por: Christmann, Philipp, et al.
Publicado: (2024)
First Token Probability Guided RAG for Telecom Question Answering
por: Chen, Tingwei, et al.
Publicado: (2025)
por: Chen, Tingwei, et al.
Publicado: (2025)
Enhanced Multimodal RAG-LLM for Accurate Visual Question Answering
por: Xue, Junxiao, et al.
Publicado: (2024)
por: Xue, Junxiao, et al.
Publicado: (2024)
RAG based Question-Answering for Contextual Response Prediction System
por: Veturi, Sriram, et al.
Publicado: (2024)
por: Veturi, Sriram, et al.
Publicado: (2024)
EfficientRAG: Efficient Retriever for Multi-Hop Question Answering
por: Zhuang, Ziyuan, et al.
Publicado: (2024)
por: Zhuang, Ziyuan, et al.
Publicado: (2024)
OCC-RAG: Optimal Cognitive Core for Faithful Question Answering
por: Savkin, Maksim, et al.
Publicado: (2026)
por: Savkin, Maksim, et al.
Publicado: (2026)
A Dual-Attention Learning Network with Word and Sentence Embedding for Medical Visual Question Answering
por: Huang, Xiaofei, et al.
Publicado: (2022)
por: Huang, Xiaofei, et al.
Publicado: (2022)
VoxRAG: A Step Toward Transcription-Free RAG Systems in Spoken Question Answering
por: Rackauckas, Zackary, et al.
Publicado: (2025)
por: Rackauckas, Zackary, et al.
Publicado: (2025)
RAG-IGBench: Innovative Evaluation for RAG-based Interleaved Generation in Open-domain Question Answering
por: Zhang, Rongyang, et al.
Publicado: (2025)
por: Zhang, Rongyang, et al.
Publicado: (2025)
ComposeRAG: A Modular and Composable RAG for Corpus-Grounded Multi-Hop Question Answering
por: Wu, Ruofan, et al.
Publicado: (2025)
por: Wu, Ruofan, et al.
Publicado: (2025)
Ensemble Transformer for Efficient and Accurate Ranking Tasks: an Application to Question Answering Systems
por: Matsubara, Yoshitomo, et al.
Publicado: (2022)
por: Matsubara, Yoshitomo, et al.
Publicado: (2022)
Decomposing Retrieval Failures in RAG for Long-Document Financial Question Answering
por: Kobeissi, Amine, et al.
Publicado: (2026)
por: Kobeissi, Amine, et al.
Publicado: (2026)
Traceable Cross-Source RAG for Chinese Tibetan Medicine Question Answering
por: Chen, Fengxian, et al.
Publicado: (2026)
por: Chen, Fengxian, et al.
Publicado: (2026)
Ejemplares similares
-
Mind the Goal: Data-Efficient Goal-Oriented Evaluation of Conversational Agents and Chatbots using Teacher Models
por: Piskala, Deepak Babu, et al.
Publicado: (2025) -
Reconciling Methodological Paradigms: Employing Large Language Models as Novice Qualitative Research Assistants in Talent Management Research
por: Bhaduri, Sreyoshi, et al.
Publicado: (2024) -
Qualitative Insights Tool (QualIT): LLM Enhanced Topic Modeling
por: Kapoor, Satya, et al.
Publicado: (2024) -
MultiFinRAG: An Optimized Multimodal Retrieval-Augmented Generation (RAG) Framework for Financial Question Answering
por: Gondhalekar, Chinmay, et al.
Publicado: (2025) -
Assessment of RAG and Fine-Tuning for Industrial Question-Answering-Applications
por: Sturm, Jakob, et al.
Publicado: (2026)