Copertina

On The Fragility of Benchmark Contamination Detection in Reasoning Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wang, Han, Li, Haoyu, Ko, Brian, Zhang, Huan
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Cryptography and Security Artificial Intelligence Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

LLM Benchmark Datasets Should Be Contamination-Resistant
di: Al-Lawati, Ali, et al.
Pubblicazione: (2026)

DPrivBench: Benchmarking LLMs' Reasoning for Differential Privacy
di: Wang, Erchi, et al.
Pubblicazione: (2026)

OCGEC: One-class Graph Embedding Classification for DNN Backdoor Detection
di: Jiang, Haoyu, et al.
Pubblicazione: (2023)

Beyond Detection: A Comprehensive Benchmark and Study on Representation Learning for Fine-Grained Webshell Family Classification
di: Han, Feijiang
Pubblicazione: (2025)

Evading Data Contamination Detection for Language Models is (too) Easy
di: Dekoninck, Jasper, et al.
Pubblicazione: (2024)

Conditional Adversarial Fragility in Financial Machine Learning under Macroeconomic Stress
di: Baviskar, Samruddhi
Pubblicazione: (2025)

Attention Tracker: Detecting Prompt Injection Attacks in LLMs
di: Hung, Kuo-Han, et al.
Pubblicazione: (2024)

SafeMLRM: Demystifying Safety in Multi-modal Large Reasoning Models
di: Fang, Junfeng, et al.
Pubblicazione: (2025)

One Token Embedding Is Enough to Deadlock Your Large Reasoning Model
di: Zhang, Mohan, et al.
Pubblicazione: (2025)

Magnitude-based Neuron Pruning for Backdoor Defens
di: Li, Nan, et al.
Pubblicazione: (2024)

A Customer Level Fraudulent Activity Detection Benchmark for Enhancing Machine Learning Model Research and Evaluation
di: Jing, Phoebe, et al.
Pubblicazione: (2024)

Large Language Models in Wireless Application Design: In-Context Learning-enhanced Automatic Network Intrusion Detection
di: Zhang, Han, et al.
Pubblicazione: (2024)

A Semantic and Clean-label Backdoor Attack against Graph Convolutional Networks
di: Dai, Jiazhu, et al.
Pubblicazione: (2025)

Effective backdoor attack on graph neural networks in link prediction tasks
di: Dai, Jiazhu, et al.
Pubblicazione: (2024)

KnowGraph: Knowledge-Enabled Anomaly Detection via Logical Reasoning on Graph Data
di: Zhou, Andy, et al.
Pubblicazione: (2024)

Towards Understanding the Fragility of Multilingual LLMs against Fine-Tuning Attacks
di: Poppi, Samuele, et al.
Pubblicazione: (2024)

Membership Inference Attack with Partial Features
di: Wang, Xurun, et al.
Pubblicazione: (2025)

Detecting Benchmark Contamination Through Watermarking
di: Sander, Tom, et al.
Pubblicazione: (2025)

Exploring Robust Intrusion Detection: A Benchmark Study of Feature Transferability in IoT Botnet Attack Detection
di: Guerra-Manzanares, Alejandro, et al.
Pubblicazione: (2026)

Pandora's White-Box: Precise Training Data Detection and Extraction in Large Language Models
di: Wang, Jeffrey G., et al.
Pubblicazione: (2024)

MemoryGraft: Persistent Compromise of LLM Agents via Poisoned Experience Retrieval
di: Srivastava, Saksham Sahai, et al.
Pubblicazione: (2025)

GuardReasoner: Towards Reasoning-based LLM Safeguards
di: Liu, Yue, et al.
Pubblicazione: (2025)

Safety Tax: Safety Alignment Makes Your Large Reasoning Models Less Reasonable
di: Huang, Tiansheng, et al.
Pubblicazione: (2025)

AEGIS: Adversarial Target-Guided Retention-Data-Free Robust Concept Erasure from Diffusion Models
di: Li, Fengpeng, et al.
Pubblicazione: (2026)

How Does a Deep Learning Model Architecture Impact Its Privacy? A Comprehensive Study of Privacy Attacks on CNNs and Transformers
di: Zhang, Guangsheng, et al.
Pubblicazione: (2022)

UDora: A Unified Red Teaming Framework against LLM Agents by Dynamically Hijacking Their Own Reasoning
di: Zhang, Jiawei, et al.
Pubblicazione: (2025)

A Generative Approach to Surrogate-based Black-box Attacks
di: Moraffah, Raha, et al.
Pubblicazione: (2024)

Accelerating IoV Intrusion Detection: Benchmarking GPU-Accelerated vs CPU-Based ML Libraries
di: Çolhak, Furkan, et al.
Pubblicazione: (2025)

Explainable AI for Comparative Analysis of Intrusion Detection Models
di: Corea, Pap M., et al.
Pubblicazione: (2024)

Data Valuation and Detections in Federated Learning
di: Li, Wenqian, et al.
Pubblicazione: (2023)

VISAT: Benchmarking Adversarial and Distribution Shift Robustness in Traffic Sign Recognition with Visual Attributes
di: Yu, Simon, et al.
Pubblicazione: (2025)

Weakest Link in the Chain: Security Vulnerabilities in Advanced Reasoning Models
di: Krishna, Arjun, et al.
Pubblicazione: (2025)

Time Travel in LLMs: Tracing Data Contamination in Large Language Models
di: Golchin, Shahriar, et al.
Pubblicazione: (2023)

Adversarial Distilled Retrieval-Augmented Guarding Model for Online Malicious Intent Detection
di: Guo, Yihao, et al.
Pubblicazione: (2025)

Predictive Auditing of Hidden Tokens in LLM APIs via Reasoning Length Estimation
di: Wang, Ziyao, et al.
Pubblicazione: (2025)

LAN: Learning Adaptive Neighbors for Real-Time Insider Threat Detection
di: Cai, Xiangrui, et al.
Pubblicazione: (2024)

PSBD: Prediction Shift Uncertainty Unlocks Backdoor Detection
di: Li, Wei, et al.
Pubblicazione: (2024)

SoSBench: Benchmarking Safety Alignment on Six Scientific Domains
di: Jiang, Fengqing, et al.
Pubblicazione: (2025)

SoK: Benchmarking Poisoning Attacks and Defenses in Federated Learning
di: Zhang, Heyi, et al.
Pubblicazione: (2025)

Finetuning Large Language Models for Vulnerability Detection
di: Shestov, Alexey, et al.
Pubblicazione: (2024)