On the Effectiveness of Membership Inference in Targeted Data Extraction from Large Language Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910034573656064 |
|---|---|
| author | Sahili, Ali Al Chehab, Ali Tajeddine, Razane |
| author_facet | Sahili, Ali Al Chehab, Ali Tajeddine, Razane |
| contents | Large Language Models (LLMs) are prone to memorizing training data, which poses serious privacy risks. Two of the most prominent concerns are training data extraction and Membership Inference Attacks (MIAs). Prior research has shown that these threats are interconnected: adversaries can extract training data from an LLM by querying the model to generate a large volume of text and subsequently applying MIAs to verify whether a particular data point was included in the training set. In this study, we integrate multiple MIA techniques into the data extraction pipeline to systematically benchmark their effectiveness. We then compare their performance in this integrated setting against results from conventional MIA benchmarks, allowing us to evaluate their practical utility in real-world extraction scenarios. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_13352 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | On the Effectiveness of Membership Inference in Targeted Data Extraction from Large Language Models Sahili, Ali Al Chehab, Ali Tajeddine, Razane Machine Learning Computation and Language Cryptography and Security Large Language Models (LLMs) are prone to memorizing training data, which poses serious privacy risks. Two of the most prominent concerns are training data extraction and Membership Inference Attacks (MIAs). Prior research has shown that these threats are interconnected: adversaries can extract training data from an LLM by querying the model to generate a large volume of text and subsequently applying MIAs to verify whether a particular data point was included in the training set. In this study, we integrate multiple MIA techniques into the data extraction pipeline to systematically benchmark their effectiveness. We then compare their performance in this integrated setting against results from conventional MIA benchmarks, allowing us to evaluate their practical utility in real-world extraction scenarios. |
| title | On the Effectiveness of Membership Inference in Targeted Data Extraction from Large Language Models |
| topic | Machine Learning Computation and Language Cryptography and Security |
| url | https://arxiv.org/abs/2512.13352 |