Cover Image

Privacy Auditing of Large Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Panda, Ashwinee, Tang, Xinyu, Nasr, Milad, Choquette-Choo, Christopher A., Mittal, Prateek
Format:	Preprint
Published:	2025
Subjects:	Cryptography and Security Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Teach LLMs to Phish: Stealing Private Information from Language Models
by: Panda, Ashwinee, et al.
Published: (2024)

Private Fine-tuning of Large Language Models with Zeroth-order Optimization
by: Tang, Xinyu, et al.
Published: (2024)

A New Linear Scaling Rule for Private Adaptive Hyperparameter Optimization
by: Panda, Ashwinee, et al.
Published: (2022)

Privacy Side Channels in Machine Learning Systems
by: Debenedetti, Edoardo, et al.
Published: (2023)

Auditing Private Prediction
by: Chadha, Karan, et al.
Published: (2024)

Are aligned neural networks adversarially aligned?
by: Carlini, Nicholas, et al.
Published: (2023)

The Last Iterate Advantage: Empirical Auditing and Principled Heuristic Analysis of Differentially Private SGD
by: Steinke, Thomas, et al.
Published: (2024)

Language Models May Verbatim Complete Text They Were Not Explicitly Trained On
by: Liu, Ken Ziyu, et al.
Published: (2025)

Privacy Amplification for Matrix Mechanisms
by: Choquette-Choo, Christopher A., et al.
Published: (2023)

LLMs unlock new paths to monetizing exploits
by: Carlini, Nicholas, et al.
Published: (2025)

IH-Challenge: A Training Dataset to Improve Instruction Hierarchy on Frontier LLMs
by: Guo, Chuan, et al.
Published: (2026)

Exploring the limits of strong membership inference attacks on large language models
by: Hayes, Jamie, et al.
Published: (2025)

Optimal Rates for $O(1)$-Smooth DP-SCO with a Single Epoch and Large Batches
by: Choquette-Choo, Christopher A., et al.
Published: (2024)

AutoAdvExBench: Benchmarking autonomous exploitation of adversarial example defenses
by: Carlini, Nicholas, et al.
Published: (2025)

Beyond Data Privacy: New Privacy Risks for Large Language Models
by: Du, Yuntao, et al.
Published: (2025)

Tight Auditing of Differential Privacy in MST and AIM
by: Ganev, Georgi, et al.
Published: (2026)

Correlated Noise Provably Beats Independent Noise for Differentially Private Learning
by: Choquette-Choo, Christopher A., et al.
Published: (2023)

Safety Alignment Should Be Made More Than Just a Few Tokens Deep
by: Qi, Xiangyu, et al.
Published: (2024)

Remote Timing Attacks on Efficient Language Model Inference
by: Carlini, Nicholas, et al.
Published: (2024)

Privacy Auditing of Multi-domain Graph Pre-trained Model under Membership Inference Attacks
by: Luo, Jiayi, et al.
Published: (2025)

Privacy Bias in Language Models: A Contextual Integrity-based Auditing Metric
by: Shvartzshnaider, Yan, et al.
Published: (2024)

Large Language Model Empowered Privacy-Protected Framework for PHI Annotation in Clinical Notes
by: Wu, Guanchen, et al.
Published: (2025)

User Inference Attacks on Large Language Models
by: Kandpal, Nikhil, et al.
Published: (2023)

Phantom: General Backdoor Attacks on Retrieval Augmented Language Generation
by: Chaudhari, Harsh, et al.
Published: (2024)

Query-Based Adversarial Prompt Generation
by: Hayase, Jonathan, et al.
Published: (2024)

Federated Foundation Models: Privacy-Preserving and Collaborative Learning for Large Models
by: Yu, Sixing, et al.
Published: (2023)

PrivTune: Efficient and Privacy-Preserving Fine-Tuning of Large Language Models via Device-Cloud Collaboration
by: Liu, Yi, et al.
Published: (2025)

The Janus Interface: How Fine-Tuning in Large Language Models Amplifies the Privacy Risks
by: Chen, Xiaoyi, et al.
Published: (2023)

Attacking LLMs and AI Agents: Advertisement Embedding Attacks Against Large Language Models
by: Guo, Qiming, et al.
Published: (2025)

Oblivionis: A Lightweight Learning and Unlearning Framework for Federated Large Language Models
by: Zhang, Fuyao, et al.
Published: (2025)

Forget to Flourish: Leveraging Machine-Unlearning on Pretrained Language Models for Privacy Leakage
by: Rashid, Md Rafi Ur, et al.
Published: (2024)

Attacking Byzantine Robust Aggregation in High Dimensions
by: Choudhary, Sarthak, et al.
Published: (2023)

SALT: Steering Activations towards Leakage-free Thinking in Chain of Thought
by: Batra, Shourya, et al.
Published: (2025)

AED: Automatic Discovery of Effective and Diverse Vulnerabilities for Autonomous Driving Policy with Large Language Models
by: Qiu, Le, et al.
Published: (2025)

Watermark Stealing in Large Language Models
by: Jovanović, Nikola, et al.
Published: (2024)

On Evaluating the Durability of Safeguards for Open-Weight LLMs
by: Qi, Xiangyu, et al.
Published: (2024)

MPU: Towards Secure and Privacy-Preserving Knowledge Unlearning for Large Language Models
by: Wang, Tiantong, et al.
Published: (2026)

Have it your way: Individualized Privacy Assignment for DP-SGD
by: Boenisch, Franziska, et al.
Published: (2023)

Auditable Homomorphic-based Decentralized Collaborative AI with Attribute-based Differential Privacy
by: Yeh, Lo-Yao, et al.
Published: (2024)

MCP Safety Audit: LLMs with the Model Context Protocol Allow Major Security Exploits
by: Radosevich, Brandon, et al.
Published: (2025)