Model Inversion Attacks on Llama 3: Extracting PII from Large Language Models

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
1. Verfasser: Sivashanmugam, Sathesh P.
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911041947959296
author Sivashanmugam, Sathesh P.
author_facet Sivashanmugam, Sathesh P.
contents Large language models (LLMs) have transformed natural language processing, but their ability to memorize training data poses significant privacy risks. This paper investigates model inversion attacks on the Llama 3.2 model, a multilingual LLM developed by Meta. By querying the model with carefully crafted prompts, we demonstrate the extraction of personally identifiable information (PII) such as passwords, email addresses, and account numbers. Our findings highlight the vulnerability of even smaller LLMs to privacy attacks and underscore the need for robust defenses. We discuss potential mitigation strategies, including differential privacy and data sanitization, and call for further research into privacy-preserving machine learning techniques.
format Preprint
id arxiv_https___arxiv_org_abs_2507_04478
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Model Inversion Attacks on Llama 3: Extracting PII from Large Language Models
Sivashanmugam, Sathesh P.
Machine Learning
Artificial Intelligence
Cryptography and Security
Large language models (LLMs) have transformed natural language processing, but their ability to memorize training data poses significant privacy risks. This paper investigates model inversion attacks on the Llama 3.2 model, a multilingual LLM developed by Meta. By querying the model with carefully crafted prompts, we demonstrate the extraction of personally identifiable information (PII) such as passwords, email addresses, and account numbers. Our findings highlight the vulnerability of even smaller LLMs to privacy attacks and underscore the need for robust defenses. We discuss potential mitigation strategies, including differential privacy and data sanitization, and call for further research into privacy-preserving machine learning techniques.
title Model Inversion Attacks on Llama 3: Extracting PII from Large Language Models
topic Machine Learning
Artificial Intelligence
Cryptography and Security
url https://arxiv.org/abs/2507.04478