Copertina

Does Data Contamination Detection Work (Well) for LLMs? A Survey and Evaluation on Detection Assumptions

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Fu, Yujuan, Uzuner, Ozlem, Yetisgen, Meliha, Xia, Fei
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

A Systematic Analysis of Large Language Models with RAG-enabled Dynamic Prompting for Medical Error Detection and Correction
di: Ahmed, Farzad, et al.
Pubblicazione: (2025)

BioMistral-NLU: Towards More Generalizable Medical Language Understanding through Instruction Tuning
di: Fu, Yujuan Velvin, et al.
Pubblicazione: (2024)

A Scoping Review of Natural Language Processing in Addressing Medically Inaccurate Information: Errors, Misinformation, and Hallucination
di: Sun, Zhaoyi, et al.
Pubblicazione: (2025)

CACER: Clinical Concept Annotations for Cancer Events and Relations
di: Fu, Yujuan, et al.
Pubblicazione: (2024)

Adapting Biomedical Abstracts into Plain language using Large Language Models
di: Gangavarapu, Haritha, et al.
Pubblicazione: (2025)

Identifying Imaging Follow-Up in Radiology Reports: A Comparative Analysis of Traditional ML and LLM Approaches
di: Park, Namu, et al.
Pubblicazione: (2025)

MEDEC: A Benchmark for Medical Error Detection and Correction in Clinical Notes
di: Abacha, Asma Ben, et al.
Pubblicazione: (2024)

Spurious Correlations and Beyond: Understanding and Mitigating Shortcut Learning in SDOH Extraction with Large Language Models
di: Sakib, Fardin Ahsan, et al.
Pubblicazione: (2025)

Extracting Social Determinants of Health from Pediatric Patient Notes Using Large Language Models: Novel Corpus and Methods
di: Fu, Yujuan, et al.
Pubblicazione: (2024)

Automated Identification of Incidentalomas Requiring Follow-Up: A Multi-Anatomy Evaluation of LLM-Based and Supervised Approaches
di: Park, Namu, et al.
Pubblicazione: (2025)

A Novel Corpus of Annotated Medical Imaging Reports and Information Extraction Results Using BERT-based Language Models
di: Park, Namu, et al.
Pubblicazione: (2024)

RadTimeline: Timeline Summarization for Longitudinal Radiological Lung Findings
di: Zhou, Sitong, et al.
Pubblicazione: (2026)

Prompting Large Language Models to Detect Dementia Family Caregivers
di: Biswas, Md Badsha, et al.
Pubblicazione: (2025)

DermaVQA-DAS: Dermatology Assessment Schema (DAS) & Datasets for Closed-Ended Question Answering & Segmentation in Patient-Generated Dermatology Images
di: Yim, Wen-wai, et al.
Pubblicazione: (2025)

Contradiction to Consensus: Dual Perspective, Multi Source Retrieval Based Claim Verification with Source Level Disagreement using LLM
di: Biswas, Md Badsha, et al.
Pubblicazione: (2026)

Large Language Model-Based Agents for Automated Research Reproducibility: An Exploratory Study in Alzheimer's Disease
di: Dobbins, Nic, et al.
Pubblicazione: (2025)

MORQA: Benchmarking Evaluation Metrics for Medical Open-Ended Question Answering
di: Yim, Wen-wai, et al.
Pubblicazione: (2025)

DCR: Quantifying Data Contamination in LLMs Evaluation
di: Xu, Cheng, et al.
Pubblicazione: (2025)

Unveiling the Spectrum of Data Contamination in Language Models: A Survey from Detection to Remediation
di: Deng, Chunyuan, et al.
Pubblicazione: (2024)

Detecting Data Contamination in LLMs via In-Context Learning
di: Zawalski, Michał, et al.
Pubblicazione: (2025)

UW-BioNLP at ChemoTimelines 2025: Thinking, Fine-Tuning, and Dictionary-Enhanced LLM Systems for Chemotherapy Timeline Extraction
di: Zhang, Tianmai M., et al.
Pubblicazione: (2025)

Retrieval-Augmented Large Language Models for Schema-Constrained Clinical Information Extraction
di: Karim, A H M Rezaul, et al.
Pubblicazione: (2026)

Assessing Large Language Models for Structured Medical Order Extraction
di: Karim, A H M Rezaul, et al.
Pubblicazione: (2025)

Quantifying Data Contamination in Psychometric Evaluations of LLMs
di: Han, Jongwook, et al.
Pubblicazione: (2025)

Multimodal Retrieval-Augmented Generation with Large Language Models for Medical VQA
di: Karim, A H M Rezaul, et al.
Pubblicazione: (2025)

A Comprehensive Survey of Contamination Detection Methods in Large Language Models
di: Ravaut, Mathieu, et al.
Pubblicazione: (2024)

CAP: Data Contamination Detection via Consistency Amplification
di: Zhao, Yi, et al.
Pubblicazione: (2024)

MasonTigers at SemEval-2024 Task 8: Performance Analysis of Transformer-based Models on Machine-Generated Text Detection
di: Puspo, Sadiya Sayara Chowdhury, et al.
Pubblicazione: (2024)

Large Language Model Capabilities in Perioperative Risk Prediction and Prognostication
di: Chung, Philip, et al.
Pubblicazione: (2024)

A Survey on Data Contamination for Large Language Models
di: Cheng, Yuxing, et al.
Pubblicazione: (2025)

Data Contamination Quiz: A Tool to Detect and Estimate Contamination in Large Language Models
di: Golchin, Shahriar, et al.
Pubblicazione: (2023)

Benchmark Data Contamination of Large Language Models: A Survey
di: Xu, Cheng, et al.
Pubblicazione: (2024)

Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMs
di: Balloccu, Simone, et al.
Pubblicazione: (2024)

Claim Check-Worthiness Detection: How Well do LLMs Grasp Annotation Guidelines?
di: Majer, Laura, et al.
Pubblicazione: (2024)

On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Survey
di: Long, Lin, et al.
Pubblicazione: (2024)

Evaluating LLMs at Detecting Errors in LLM Responses
di: Kamoi, Ryo, et al.
Pubblicazione: (2024)

Hallucination is Inevitable for LLMs with the Open World Assumption
di: Xu, Bowen
Pubblicazione: (2025)

Evading Data Contamination Detection for Language Models is (too) Easy
di: Dekoninck, Jasper, et al.
Pubblicazione: (2024)

TRUCE: Private Benchmarking to Prevent Contamination and Improve Comparative Evaluation of LLMs
di: Rajore, Tanmay, et al.
Pubblicazione: (2024)

ConStat: Performance-Based Contamination Detection in Large Language Models
di: Dekoninck, Jasper, et al.
Pubblicazione: (2024)