Cover Image

DisasterQA: A Benchmark for Assessing the performance of LLMs in Disaster Response

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Rawat, Rajat
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

DisastQA: A Comprehensive Benchmark for Evaluating Question Answering in Disaster Management
by: Chen, Zhitong, et al.
Published: (2026)

GeoResponder: Towards Building Geospatial LLMs for Time-Critical Disaster Response
by: Zguir, Ahmed El Fekih, et al.
Published: (2025)

DiversityMedQA: Assessing Demographic Biases in Medical Diagnosis using Large Language Models
by: Rawat, Rajat, et al.
Published: (2024)

Flood of Techniques and Drought of Theories: Emotion Mining in Disasters
by: Shapouri, Soheil, et al.
Published: (2024)

Compound-QA: A Benchmark for Evaluating LLMs on Compound Questions
by: Hou, Yutao, et al.
Published: (2024)

Generalizing to Unseen Disaster Events: A Causal View
by: Seeberger, Philipp, et al.
Published: (2025)

Infrastructure Ombudsman: Mining Future Failure Concerns from Structural Disaster Response
by: Chowdhury, Md Towhidul Absar, et al.
Published: (2024)

Factuality or Fiction? Benchmarking Modern LLMs on Ambiguous QA with Citations
by: Patel, Maya, et al.
Published: (2024)

Harnessing Large Language Models for Disaster Management: A Survey
by: Lei, Zhenyu, et al.
Published: (2025)

Multi-Query Focused Disaster Summarization via Instruction-Based Prompting
by: Seeberger, Philipp, et al.
Published: (2024)

KoSimpleQA: A Korean Factuality Benchmark with an Analysis of Reasoning LLMs
by: Ko, Donghyeon, et al.
Published: (2025)

FRIDA to the Rescue! Analyzing Synthetic Data Effectiveness in Object-Based Common Sense Reasoning for Disaster Response
by: Shichman, Mollie, et al.
Published: (2025)

Multimodal Learning with Augmentation Techniques for Natural Disaster Assessment
by: Urse, Adrian-Dinu, et al.
Published: (2025)

HypoTermQA: Hypothetical Terms Dataset for Benchmarking Hallucination Tendency of LLMs
by: Uluoglakci, Cem, et al.
Published: (2024)

A Lightweight LLM Framework for Disaster Humanitarian Information Classification
by: Jinzhen, Han, et al.
Published: (2026)

LLMs as World Models: Data-Driven and Human-Centered Pre-Event Simulation for Disaster Impact Assessment
by: Li, Lingyao, et al.
Published: (2025)

QA-LIGN: Aligning LLMs through Constitutionally Decomposed QA
by: Dineen, Jacob, et al.
Published: (2025)

Comparative Analysis of Transformer Models in Disaster Tweet Classification for Public Safety
by: Zisad, Sharif Noor, et al.
Published: (2025)

Can LLMs Evaluate Complex Attribution in QA? Automatic Benchmarking using Knowledge Graphs
by: Hu, Nan, et al.
Published: (2024)

JBE-QA: Japanese Bar Exam QA Dataset for Assessing Legal Domain Knowledge
by: Cao, Zhihan, et al.
Published: (2025)

RSCC: A Large-Scale Remote Sensing Change Caption Dataset for Disaster Events
by: Chen, Zhenyuan, et al.
Published: (2025)

The Newsworthiness of Brazilian Distress: A Peak Analysis on Time Series of International Media Attention to Disasters in Brazil
by: Madureira, Brielen, et al.
Published: (2026)

Multi-OphthaLingua: A Multilingual Benchmark for Assessing and Debiasing LLM Ophthalmological QA in LMICs
by: Restrepo, David, et al.
Published: (2024)

DisasterVQA: A Visual Question Answering Benchmark Dataset for Disaster Scenes
by: Al-Mohannadi, Aisha, et al.
Published: (2026)

DisasterInsight: A Multimodal Benchmark for Function-Aware and Grounded Disaster Assessment
by: Tehrani, Sara, et al.
Published: (2026)

Beyond QA Pairs: Assessing Parameter-Efficient Fine-Tuning for Fact Embedding in LLMs
by: Ratnakar, Shivam, et al.
Published: (2025)

Enhancing the Preference Extractor in Multi-turn Dialogues: From Annotating Disasters to Accurate Preference Extraction
by: Wang, Cheng, et al.
Published: (2025)

ADSumm: Annotated Ground-truth Summary Datasets for Disaster Tweet Summarization
by: Garg, Piyush Kumar, et al.
Published: (2024)

HumMusQA: A Human-written Music Understanding QA Benchmark Dataset
by: Weck, Benno, et al.
Published: (2026)

RefactorCoderQA: Benchmarking LLMs for Multi-Domain Coding Question Solutions in Cloud and Edge Deployment
by: Rahman, Shadikur, et al.
Published: (2025)

RepLiQA: A Question-Answering Dataset for Benchmarking LLMs on Unseen Reference Content
by: Monteiro, Joao, et al.
Published: (2024)

MedEthicsQA: A Comprehensive Question Answering Benchmark for Medical Ethics Evaluation of LLMs
by: Wei, Jianhui, et al.
Published: (2025)

Public Health in Disaster: Emotional Health and Life Incidents Extraction during Hurricane Harvey
by: Hoang, Thomas, et al.
Published: (2024)

PUB: A Pragmatics Understanding Benchmark for Assessing LLMs' Pragmatics Capabilities
by: Sravanthi, Settaluri Lakshmi, et al.
Published: (2024)

A Named Entity Recognition and Topic Modeling-based Solution for Locating and Better Assessment of Natural Disasters in Social Media
by: Mehmood, Ayaz, et al.
Published: (2024)

Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA
by: Wang, Minzheng, et al.
Published: (2024)

MedConceptsQA: Open Source Medical Concepts QA Benchmark
by: Shoham, Ofir Ben, et al.
Published: (2024)

Active Learning for Identifying Disaster-Related Tweets: A Comparison with Keyword Filtering and Generic Fine-Tuning
by: Hanny, David, et al.
Published: (2024)

Contextual Breach: Assessing the Robustness of Transformer-based QA Models
by: Saadat, Asir, et al.
Published: (2024)

Assessing Thai Dialect Performance in LLMs with Automatic Benchmarks and Human Evaluation
by: Limkonchotiwat, Peerat, et al.
Published: (2025)