Copertina

INDIC QA BENCHMARK: A Multilingual Benchmark to Evaluate Question Answering capability of LLMs for Indic Languages

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Singh, Abhishek Kumar, kumar, Vishwajeet, Murthy, Rudra, Sen, Jaydeep, Mittal, Ashish, Ramakrishnan, Ganesh
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

MILU: A Multi-task Indic Language Understanding Benchmark
di: Verma, Sshubam, et al.
Pubblicazione: (2024)

Hindi-BEIR : A Large Scale Retrieval Benchmark in Hindi
di: Acharya, Arkadeep, et al.
Pubblicazione: (2024)

Benchmarking and Building Zero-Shot Hindi Retrieval Model with Hindi-BEIR and NLLB-E5
di: Acharya, Arkadeep, et al.
Pubblicazione: (2024)

Mistral-SPLADE: LLMs for better Learned Sparse Retrieval
di: Doshi, Meet, et al.
Pubblicazione: (2024)

IndicGenBench: A Multilingual Benchmark to Evaluate Generation Capabilities of LLMs on Indic Languages
di: Singh, Harman, et al.
Pubblicazione: (2024)

IndicSQuAD: A Comprehensive Multilingual Question Answering Dataset for Indic Languages
di: Endait, Sharvi, et al.
Pubblicazione: (2025)

Dynamic Multi-Expert Projectors with Stabilized Routing for Multilingual Speech Recognition
di: Pandey, Isha, et al.
Pubblicazione: (2026)

LittiChoQA: Literary Texts in Indic Languages Chosen for Question Answering
di: Khandelwal, Aarya, et al.
Pubblicazione: (2026)

Multilingual State Space Models for Structured Question Answering in Indic Languages
di: Vats, Arpita, et al.
Pubblicazione: (2025)

L3Cube-IndicQuest: A Benchmark Question Answering Dataset for Evaluating Knowledge of LLMs in Indic Context
di: Rohera, Pritika, et al.
Pubblicazione: (2024)

Evaluating Monolingual and Multilingual Large Language Models for Greek Question Answering: The DemosQA Benchmark
di: Mastrokostas, Charalampos, et al.
Pubblicazione: (2026)

MedExpQA: Multilingual Benchmarking of Large Language Models for Medical Question Answering
di: Alonso, Iñigo, et al.
Pubblicazione: (2024)

Influence Guided Sampling for Domain Adaptation of Text Retrievers
di: Doshi, Meet, et al.
Pubblicazione: (2026)

INDIC DIALECT: A Multi Task Benchmark to Evaluate and Translate in Indian Language Dialects
di: Sharma, Tarun, et al.
Pubblicazione: (2026)

Table Question Answering for Low-resourced Indic Languages
di: Pal, Vaishali, et al.
Pubblicazione: (2024)

A Three-Pronged Approach to Cross-Lingual Adaptation with Multilingual LLMs
di: Singh, Vaibhav, et al.
Pubblicazione: (2024)

MedEthicsQA: A Comprehensive Question Answering Benchmark for Medical Ethics Evaluation of LLMs
di: Wei, Jianhui, et al.
Pubblicazione: (2025)

IndicDB -- Benchmarking Multilingual Text-to-SQL Capabilities in Indian Languages
di: Dawar, Aviral, et al.
Pubblicazione: (2026)

Long-context Non-factoid Question Answering in Indic Languages
di: Mishra, Ritwik, et al.
Pubblicazione: (2025)

Lost in Transcription: How Speech-to-Text Errors Derail Code Understanding
di: Havare, Jayant, et al.
Pubblicazione: (2026)

M2QA: Multi-domain Multilingual Question Answering
di: Engländer, Leon, et al.
Pubblicazione: (2024)

Leveraging Synthetic Data for Question Answering with Multilingual LLMs in the Agricultural Domain
di: Kaur, Rishemjit, et al.
Pubblicazione: (2025)

CodeVaani: A Multilingual, Voice-Based Code Learning Assistant
di: Havare, Jayant, et al.
Pubblicazione: (2025)

IndicParam: Benchmark to evaluate LLMs on low-resource Indic Languages
di: Maheshwari, Ayush, et al.
Pubblicazione: (2025)

FIND: Toward Multimodal Financial Reasoning and Question Answering for Indic Languages
di: Das, Sarmistha, et al.
Pubblicazione: (2026)

On the Calibration of Multilingual Question Answering LLMs
di: Yang, Yahan, et al.
Pubblicazione: (2023)

HistoryBankQA: Multilingual Temporal Question Answering on Historical Events
di: Mandal, Biswadip, et al.
Pubblicazione: (2025)

Mathematics Isn't Culture-Free: Probing Cultural Gaps via Entity and Scenario Perturbations
di: Tomar, Aditya, et al.
Pubblicazione: (2025)

DisastQA: A Comprehensive Benchmark for Evaluating Question Answering in Disaster Management
di: Chen, Zhitong, et al.
Pubblicazione: (2026)

Compound-QA: A Benchmark for Evaluating LLMs on Compound Questions
di: Hou, Yutao, et al.
Pubblicazione: (2024)

MizanQA: Benchmarking Large Language Models on Moroccan Legal Question Answering
di: Bahaj, Adil, et al.
Pubblicazione: (2025)

Improving Multilingual Neural Machine Translation System for Indic Languages
di: Das, Sudhansu Bala, et al.
Pubblicazione: (2022)

Evaluating Robustness of LLMs in Question Answering on Multilingual Noisy OCR Data
di: Piryani, Bhawna, et al.
Pubblicazione: (2025)

RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen Reference Content
di: Monteiro, Joao, et al.
Pubblicazione: (2024)

ClimaQA_SLO - Slovenian Climate Question-Answering Benchmark
di: Ferk Ovčjak, Monika, et al.
Pubblicazione: (2025)

DebateQA: Evaluating Question Answering on Debatable Knowledge
di: Xu, Rongwu, et al.
Pubblicazione: (2024)

CyberMaskQA: A Privacy-Aware Benchmark for Evaluating Large Language Models in Cybersecurity Question Answering
di: Gaddi, Matilda, et al.
Pubblicazione: (2026)

EconLogicQA: A Question-Answering Benchmark for Evaluating Large Language Models in Economic Sequential Reasoning
di: Quan, Yinzhu, et al.
Pubblicazione: (2024)

FairMedQA: Benchmarking Bias in Large Language Models for Medical Question Answering
di: Xiao, Ying, et al.
Pubblicazione: (2025)

IndicSafe: A Benchmark for Evaluating Multilingual LLM Safety in South Asia
di: Pattnayak, Priyaranjan, et al.
Pubblicazione: (2026)