Copertina

L3Cube-IndicQuest: A Benchmark Question Answering Dataset for Evaluating Knowledge of LLMs in Indic Context

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Rohera, Pritika, Ginimav, Chaitrali, Salunke, Akanksha, Sawant, Gayatri, Joshi, Raviraj
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Better To Ask in English? Evaluating Factual Accuracy of Multilingual LLMs in English and Low-Resource Languages
di: Rohera, Pritika, et al.
Pubblicazione: (2025)

IndicSQuAD: A Comprehensive Multilingual Question Answering Dataset for Indic Languages
di: Endait, Sharvi, et al.
Pubblicazione: (2025)

L3Cube-IndicNews: News-based Short Text and Long Document Classification Datasets in Indic Languages
di: Mirashi, Aishwarya, et al.
Pubblicazione: (2024)

L3Cube-IndicHeadline-ID: A Dataset for Headline Identification and Semantic Evaluation in Low-Resource Indian Languages
di: Tanksale, Nishant, et al.
Pubblicazione: (2025)

IndicParam: Benchmark to evaluate LLMs on low-resource Indic Languages
di: Maheshwari, Ayush, et al.
Pubblicazione: (2025)

IndicGenBench: A Multilingual Benchmark to Evaluate Generation Capabilities of LLMs on Indic Languages
di: Singh, Harman, et al.
Pubblicazione: (2024)

Table Question Answering for Low-resourced Indic Languages
di: Pal, Vaishali, et al.
Pubblicazione: (2024)

Long-context Non-factoid Question Answering in Indic Languages
di: Mishra, Ritwik, et al.
Pubblicazione: (2025)

IndicIFEval: A Benchmark for Verifiable Instruction-Following Evaluation in 14 Indic Languages
di: Jayakumar, Thanmay, et al.
Pubblicazione: (2026)

FIND: Toward Multimodal Financial Reasoning and Question Answering for Indic Languages
di: Das, Sarmistha, et al.
Pubblicazione: (2026)

L3Cube-MahaSTS: A Marathi Sentence Similarity Dataset and Models
di: Mirashi, Aishwarya, et al.
Pubblicazione: (2025)

Multilingual State Space Models for Structured Question Answering in Indic Languages
di: Vats, Arpita, et al.
Pubblicazione: (2025)

LittiChoQA: Literary Texts in Indic Languages Chosen for Question Answering
di: Khandelwal, Aarya, et al.
Pubblicazione: (2026)

QUENCH: Measuring the gap between Indic and Non-Indic Contextual General Reasoning in LLMs
di: Khan, Mohammad Aflah, et al.
Pubblicazione: (2024)

Analysis of Indic Language Capabilities in LLMs
di: Vaidya, Aatman, et al.
Pubblicazione: (2025)

IndicMMLU-Pro: Benchmarking Indic Large Language Models on Multi-Task Language Understanding
di: KJ, Sankalp, et al.
Pubblicazione: (2025)

L3Cube-MahaEmotions: A Marathi Emotion Recognition Dataset with Synthetic Annotations using CoTR prompting and Large Language Models
di: Kowtal, Nidhi, et al.
Pubblicazione: (2025)

IndicRAGSuite: Large-Scale Datasets and a Benchmark for Indian Language RAG Systems
di: Prasanjith, Pasunuti, et al.
Pubblicazione: (2025)

IndicMedDialog: A Parallel Multi-Turn Medical Dialogue Dataset for Accessible Healthcare in Indic Languages
di: Nigam, Shubham Kumar, et al.
Pubblicazione: (2026)

IndicEval-XL: Bridging Linguistic Diversity in Code Generation Across Indic Languages
di: Singh, Ujjwal, et al.
Pubblicazione: (2025)

INDIC QA BENCHMARK: A Multilingual Benchmark to Evaluate Question Answering capability of LLMs for Indic Languages
di: Singh, Abhishek Kumar, et al.
Pubblicazione: (2024)

Evaluating Cross-lingual Knowledge Consistency in Code-Mixed vis-a-vis Indian Languages using IndicKLAR
di: Mazumder, Debajyoti, et al.
Pubblicazione: (2026)

ELR-1000: A Community-Generated Dataset for Endangered Indic Indigenous Languages
di: Joshi, Neha, et al.
Pubblicazione: (2025)

MILU: A Multi-task Indic Language Understanding Benchmark
di: Verma, Sshubam, et al.
Pubblicazione: (2024)

Multilingual Evaluation of Semantic Textual Relatedness
di: Endait, Sharvi, et al.
Pubblicazione: (2024)

IndicSafe: A Benchmark for Evaluating Multilingual LLM Safety in South Asia
di: Pattnayak, Priyaranjan, et al.
Pubblicazione: (2026)

IndicVoices: Towards building an Inclusive Multilingual Speech Dataset for Indian Languages
di: Javed, Tahir, et al.
Pubblicazione: (2024)

ParamBench: A Graduate-Level Benchmark for Evaluating LLM Understanding on Indic Subjects
di: Maheshwari, Ayush, et al.
Pubblicazione: (2025)

L3Cube-MahaSum: A Comprehensive Dataset and BART Models for Abstractive Text Summarization in Marathi
di: Deshmukh, Pranita, et al.
Pubblicazione: (2024)

L3Cube-MahaNews: News-based Short Text and Long Document Classification Datasets in Marathi
di: Mittal, Saloni, et al.
Pubblicazione: (2024)

Statistical Machine Translation for Indic Languages
di: Das, Sudhansu Bala, et al.
Pubblicazione: (2023)

L3Cube-MahaSocialNER: A Social Media based Marathi NER Dataset and BERT models
di: Chaudhari, Harsh, et al.
Pubblicazione: (2023)

PSP: An Interpretable Per-Dimension Accent Benchmark for Indic Text-to-Speech
di: Menta, Venkata Pushpak Teja
Pubblicazione: (2026)

Overview of the 2023 ICON Shared Task on Gendered Abuse Detection in Indic Languages
di: Vaidya, Aatman, et al.
Pubblicazione: (2024)

Safer in Translation? Presupposition Robustness in Indic Languages
di: Palnitkar, Aadi, et al.
Pubblicazione: (2025)

Unicode Normalization and Grapheme Parsing of Indic Languages
di: Ansary, Nazmuddoha, et al.
Pubblicazione: (2023)

IndicSentEval: How Effectively do Multilingual Transformer Models encode Linguistic Properties for Indic Languages?
di: Aravapalli, Akhilesh, et al.
Pubblicazione: (2024)

IndicDB -- Benchmarking Multilingual Text-to-SQL Capabilities in Indian Languages
di: Dawar, Aviral, et al.
Pubblicazione: (2026)

BhashaBench V1: A Comprehensive Benchmark for the Quadrant of Indic Domains
di: Devane, Vijay, et al.
Pubblicazione: (2025)

IndicGEC: Powerful Models, or a Measurement Mirage?
di: Vajjala, Sowmya
Pubblicazione: (2025)