Cover Image

LLM Benchmark Datasets Should Be Contamination-Resistant

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Al-Lawati, Ali, Lucas, Jason, Lee, Dongwon, Wang, Suhang
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence Cryptography and Security
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Do Multimodal RAG Systems Leak Data? A Comprehensive Evaluation of Membership Inference and Image Caption Retrieval Attacks
by: Al-Lawati, Ali, et al.
Published: (2026)

On The Fragility of Benchmark Contamination Detection in Reasoning Models
by: Wang, Han, et al.
Published: (2025)

Unlearning Inversion Attacks for Graph Neural Networks
by: Zhang, Jiahao, et al.
Published: (2025)

Catastrophic Cyber Capabilities Benchmark (3CB): Robustly Evaluating LLM Agent Cyber Offense Capabilities
by: Anurin, Andrey, et al.
Published: (2024)

Ward: Provable RAG Dataset Inference via LLM Watermarks
by: Jovanović, Nikola, et al.
Published: (2024)

Position: AI Security Policy Should Target Systems, Not Models
by: Riegler, Michael A., et al.
Published: (2026)

Efficient but Vulnerable: Benchmarking and Defending LLM Batch Prompting Attack
by: Yue, Murong, et al.
Published: (2025)

PhreshPhish: A Real-World, High-Quality, Large-Scale Phishing Website Dataset and Benchmark
by: Dalton, Thomas, et al.
Published: (2025)

Hybrid LLM-Enhanced Intrusion Detection for Zero-Day Threats in IoT Networks
by: Al-Hammouri, Mohammad F., et al.
Published: (2025)

CySecBench: Generative AI-based CyberSecurity-focused Prompt Dataset for Benchmarking Large Language Models
by: Wahréus, Johan, et al.
Published: (2025)

Mind the Gap: Missing Cyber Threat Coverage in NIDS Datasets for the Energy Sector
by: Tory, Adrita Rahman, et al.
Published: (2025)

Attention Eclipse: Manipulating Attention to Bypass LLM Safety-Alignment
by: Zaree, Pedram, et al.
Published: (2025)

DPrivBench: Benchmarking LLMs' Reasoning for Differential Privacy
by: Wang, Erchi, et al.
Published: (2026)

Turning Black Box into White Box: Dataset Distillation Leaks
by: Chen, Huajie, et al.
Published: (2026)

Pandora's White-Box: Precise Training Data Detection and Extraction in Large Language Models
by: Wang, Jeffrey G., et al.
Published: (2024)

PHANTOM: Progressive High-fidelity Adversarial Network for Threat Object Modeling
by: Al-Karaki, Jamal, et al.
Published: (2025)

BAFFLE: Hiding Backdoors in Offline Reinforcement Learning Datasets
by: Gong, Chen, et al.
Published: (2022)

Combining Stochastic Defenses to Resist Gradient Inversion: An Ablation Study
by: Scheliga, Daniel, et al.
Published: (2022)

A Visualized Malware Detection Framework with CNN and Conditional GAN
by: Wang, Fang, et al.
Published: (2024)

Deep Reinforcement Learning for Phishing Detection with Transformer-Based Semantic Features
by: Faisal, Aseer Al
Published: (2025)

Robustness of LLM-enabled vehicle trajectory prediction under data security threats
by: Wang, Feilong, et al.
Published: (2025)

Watermarking Should Be Treated as a Monitoring Primitive
by: Aremu, Toluwani, et al.
Published: (2026)

How Catastrophic is Your LLM? Certifying Risk in Conversation
by: Wang, Chengxiao, et al.
Published: (2025)

Reliable Weak-to-Strong Monitoring of LLM Agents
by: Kale, Neil, et al.
Published: (2025)

Uncovering Logit Suppression Vulnerabilities in LLM Safety Alignment
by: Li, Yuxi, et al.
Published: (2024)

Safe Delta: Consistently Preserving Safety when Fine-Tuning LLMs on Diverse Datasets
by: Lu, Ning, et al.
Published: (2025)

TracLLM: A Generic Framework for Attributing Long Context LLMs
by: Wang, Yanting, et al.
Published: (2025)

Exploiting LLM Quantization
by: Egashira, Kazuki, et al.
Published: (2024)

Embedding Hidden Adversarial Capabilities in Pre-Trained Diffusion Models
by: Beerens, Lucas, et al.
Published: (2025)

Intellectual Property Protection for Deep Learning Model and Dataset Intelligence
by: Jiang, Yongqi, et al.
Published: (2024)

Evading Data Contamination Detection for Language Models is (too) Easy
by: Dekoninck, Jasper, et al.
Published: (2024)

WAREX: Web Agent Reliability Evaluation on Existing Benchmarks
by: Kara, Su, et al.
Published: (2025)

Predictive Auditing of Hidden Tokens in LLM APIs via Reasoning Length Estimation
by: Wang, Ziyao, et al.
Published: (2025)

OEP: Poisoning Self-Evolving LLM Agents via Locally Correct but Non-Transferable Experiences
by: Wang, Kaixiang, et al.
Published: (2026)

Functional Homotopy: Smoothing Discrete Optimization via Continuous Parameters for LLM Jailbreak Attacks
by: Wang, Zi, et al.
Published: (2024)

SALAD: Systematic Assessment of Machine Unlearning on LLM-Aided Hardware Design
by: Wang, Zeng, et al.
Published: (2025)

LeakAgent: RL-based Red-teaming Agent for LLM Privacy Leakage
by: Nie, Yuzhou, et al.
Published: (2024)

Democratising Clinical AI through Dataset Condensation for Classical Clinical Models
by: Thakur, Anshul, et al.
Published: (2026)

DATABench: Evaluating Dataset Auditing in Deep Learning from an Adversarial Perspective
by: Shao, Shuo, et al.
Published: (2025)

A Unified Framework for LLM Watermarks
by: Gloaguen, Thibaud, et al.
Published: (2026)