Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2505.13249 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916744316059648 |
|---|---|
| author | Anh, Le Vu Nguyen, Dinh Duc Nha Nguyen, Phi Long |
| author_facet | Anh, Le Vu Nguyen, Dinh Duc Nha Nguyen, Phi Long |
| contents | Large Language Models (LLMs) have become foundational in modern artificial intelligence, powering a wide range of applications from code generation and virtual assistants to scientific research and enterprise automation. However, concerns about data contamination--where test data overlaps with training data--have raised serious questions about the reliability of these applications. Despite awareness of this issue, existing methods fall short in effectively identifying or mitigating contamination. In this paper, we propose Residual-Noise Fingerprinting (RN-F), a novel framework for detecting contaminated data in LLMs. RN-F is a single-pass, gradient-free detection method that leverages residual signal patterns without introducing additional floating-point operations. Our approach is lightweight, model-agnostic, and efficient. We evaluate RN-F on multiple LLMs across various contaminated datasets and show that it consistently outperforms existing state-of-the-art methods, achieving performance improvements of up to 10.5% in contamination detection metrics. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_13249 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | RN-F: A Novel Approach for Mitigating Contaminated Data in Large Language Models Anh, Le Vu Nguyen, Dinh Duc Nha Nguyen, Phi Long Machine Learning Large Language Models (LLMs) have become foundational in modern artificial intelligence, powering a wide range of applications from code generation and virtual assistants to scientific research and enterprise automation. However, concerns about data contamination--where test data overlaps with training data--have raised serious questions about the reliability of these applications. Despite awareness of this issue, existing methods fall short in effectively identifying or mitigating contamination. In this paper, we propose Residual-Noise Fingerprinting (RN-F), a novel framework for detecting contaminated data in LLMs. RN-F is a single-pass, gradient-free detection method that leverages residual signal patterns without introducing additional floating-point operations. Our approach is lightweight, model-agnostic, and efficient. We evaluate RN-F on multiple LLMs across various contaminated datasets and show that it consistently outperforms existing state-of-the-art methods, achieving performance improvements of up to 10.5% in contamination detection metrics. |
| title | RN-F: A Novel Approach for Mitigating Contaminated Data in Large Language Models |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2505.13249 |