Copertina

Factuality or Fiction? Benchmarking Modern LLMs on Ambiguous QA with Citations

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Patel, Maya, Anand, Aditi
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

KoSimpleQA: A Korean Factuality Benchmark with an Analysis of Reasoning LLMs
di: Ko, Donghyeon, et al.
Pubblicazione: (2025)

CondAmbigQA: A Benchmark and Dataset for Conditional Ambiguous Question Answering
di: Li, Zongxi, et al.
Pubblicazione: (2025)

AdversaRiskQA: An Adversarial Factuality Benchmark for High-Risk Domains
di: Szelestey, Adam, et al.
Pubblicazione: (2026)

SimpleQA Verified: A Reliable Factuality Benchmark to Measure Parametric Knowledge
di: Haas, Lukas, et al.
Pubblicazione: (2025)

Enhancing Factual Accuracy and Citation Generation in LLMs via Multi-Stage Self-Verification
di: García, Fernando Gabriela, et al.
Pubblicazione: (2025)

ComparisonQA: Evaluating Factuality Robustness of LLMs Through Knowledge Frequency Control and Uncertainty
di: Zong, Qing, et al.
Pubblicazione: (2024)

LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA
di: Zhang, Jiajie, et al.
Pubblicazione: (2024)

Learning to Generate Answers with Citations via Factual Consistency Models
di: Aly, Rami, et al.
Pubblicazione: (2024)

Chinese SafetyQA: A Safety Short-form Factuality Benchmark for Large Language Models
di: Tan, Yingshui, et al.
Pubblicazione: (2024)

Understanding Finetuning for Factual Knowledge Extraction
di: Ghosal, Gaurav, et al.
Pubblicazione: (2024)

CodeSimpleQA: Scaling Factuality in Code Large Language Models
di: Yang, Jian, et al.
Pubblicazione: (2025)

Compound-QA: A Benchmark for Evaluating LLMs on Compound Questions
di: Hou, Yutao, et al.
Pubblicazione: (2024)

MoleculeQA: A Dataset to Evaluate Factual Accuracy in Molecular Comprehension
di: Lu, Xingyu, et al.
Pubblicazione: (2024)

Chinese SimpleQA: A Chinese Factuality Evaluation for Large Language Models
di: He, Yancheng, et al.
Pubblicazione: (2024)

DisasterQA: A Benchmark for Assessing the performance of LLMs in Disaster Response
di: Rawat, Rajat
Pubblicazione: (2024)

FictionalQA: A Dataset for Studying Memorization and Knowledge Acquisition
di: Kirchenbauer, John, et al.
Pubblicazione: (2025)

HypoTermQA: Hypothetical Terms Dataset for Benchmarking Hallucination Tendency of LLMs
di: Uluoglakci, Cem, et al.
Pubblicazione: (2024)

AMBROSIA: A Benchmark for Parsing Ambiguous Questions into Database Queries
di: Saparina, Irina, et al.
Pubblicazione: (2024)

BioPulse-QA: A Dynamic Biomedical Question-Answering Benchmark for Evaluating Factuality, Robustness, and Bias in Large Language Models
di: Bhattarai, Kriti, et al.
Pubblicazione: (2026)

QA-LIGN: Aligning LLMs through Constitutionally Decomposed QA
di: Dineen, Jacob, et al.
Pubblicazione: (2025)

Can LLMs Evaluate Complex Attribution in QA? Automatic Benchmarking using Knowledge Graphs
di: Hu, Nan, et al.
Pubblicazione: (2024)

Inside-Out: Hidden Factual Knowledge in LLMs
di: Gekhman, Zorik, et al.
Pubblicazione: (2025)

LLMs as Repositories of Factual Knowledge: Limitations and Solutions
di: Mousavi, Seyed Mahed, et al.
Pubblicazione: (2025)

ART: Attention Replacement Technique to Improve Factuality in LLMs
di: Luo, Ziqin, et al.
Pubblicazione: (2026)

A Diagnostic Benchmark for Sweden-Related Factual Knowledge
di: Kunz, Jenny
Pubblicazione: (2025)

EWEK-QA: Enhanced Web and Efficient Knowledge Graph Retrieval for Citation-based Question Answering Systems
di: Dehghan, Mohammad, et al.
Pubblicazione: (2024)

Beyond Factual QA: Mentorship-Oriented Question Answering over Long-Form Multilingual Content
di: Bhalerao, Parth, et al.
Pubblicazione: (2026)

Benchmarking the Detection of LLMs-Generated Modern Chinese Poetry
di: Wang, Shanshan, et al.
Pubblicazione: (2025)

RefactorCoderQA: Benchmarking LLMs for Multi-Domain Coding Question Solutions in Cloud and Edge Deployment
di: Rahman, Shadikur, et al.
Pubblicazione: (2025)

Can LLMs Detect Ambiguous Plural Reference? An Analysis of Split-Antecedent and Mereological Reference
di: Anh, Dang, et al.
Pubblicazione: (2025)

Conformal Language Model Reasoning with Coherent Factuality
di: Rubin-Toles, Maxon, et al.
Pubblicazione: (2025)

CLAMBER: A Benchmark of Identifying and Clarifying Ambiguous Information Needs in Large Language Models
di: Zhang, Tong, et al.
Pubblicazione: (2024)

Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA
di: Wang, Minzheng, et al.
Pubblicazione: (2024)

DEEPAMBIGQA: Ambiguous Multi-hop Questions for Benchmarking LLM Answer Completeness
di: Ji, Jiabao, et al.
Pubblicazione: (2025)

Persuasion Tokens for Editing Factual Knowledge in LLMs
di: Youssef, Paul, et al.
Pubblicazione: (2026)

Reducing Hallucinations in LLMs via Factuality-Aware Preference Learning
di: Chaduvula, Sindhuja, et al.
Pubblicazione: (2026)

UAQFact: Evaluating Factual Knowledge Utilization of LLMs on Unanswerable Questions
di: Tan, Chuanyuan, et al.
Pubblicazione: (2025)

Mask-DPO: Generalizable Fine-grained Factuality Alignment of LLMs
di: Gu, Yuzhe, et al.
Pubblicazione: (2025)

Generating Benchmarks for Factuality Evaluation of Language Models
di: Muhlgay, Dor, et al.
Pubblicazione: (2023)

MedConceptsQA: Open Source Medical Concepts QA Benchmark
di: Shoham, Ofir Ben, et al.
Pubblicazione: (2024)