Assessing Per-Sample Membership Inference Vulnerability without Retraining

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Dorseuil, Valentin, Atif, Jamal, Cappé, Olivier
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917535515934720
author Dorseuil, Valentin
Atif, Jamal
Cappé, Olivier
author_facet Dorseuil, Valentin
Atif, Jamal
Cappé, Olivier
contents Recent work in the privacy literature shows that sample-targeted membership inference attacks (MIAs) significantly outperform untargeted approaches by a wide margin. Motivated by this observation, we address the following question: can the privacy vulnerability of individual training points be assessed without training shadow models? We show that per-sample exposure to MIA is governed not only by a point's loss, but also by a data-dependent geometric measure. In the linear setting, we derive a closed-form decomposition of individual black-box MIA vulnerability into a population leverage score and a residual loss term, making explicit how sample-dependent geometry translates into privacy exposure. Since the final layer of most modern architectures is linear, we extend this framework to deep networks and propose a surrogate score operating on last-layer representations that requires only a single trained model and no shadow models. Empirical evaluations across diverse datasets and architectures show that our score outperforms loss and gradient-norm baselines at identifying the highest-risk points under state-of-the-art attacks, providing a computationally efficient and theoretically grounded tool for per-sample privacy risk assessment.
format Preprint
id arxiv_https___arxiv_org_abs_2602_15919
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Assessing Per-Sample Membership Inference Vulnerability without Retraining
Dorseuil, Valentin
Atif, Jamal
Cappé, Olivier
Machine Learning
Artificial Intelligence
Recent work in the privacy literature shows that sample-targeted membership inference attacks (MIAs) significantly outperform untargeted approaches by a wide margin. Motivated by this observation, we address the following question: can the privacy vulnerability of individual training points be assessed without training shadow models? We show that per-sample exposure to MIA is governed not only by a point's loss, but also by a data-dependent geometric measure. In the linear setting, we derive a closed-form decomposition of individual black-box MIA vulnerability into a population leverage score and a residual loss term, making explicit how sample-dependent geometry translates into privacy exposure. Since the final layer of most modern architectures is linear, we extend this framework to deep networks and propose a surrogate score operating on last-layer representations that requires only a single trained model and no shadow models. Empirical evaluations across diverse datasets and architectures show that our score outperforms loss and gradient-norm baselines at identifying the highest-risk points under state-of-the-art attacks, providing a computationally efficient and theoretically grounded tool for per-sample privacy risk assessment.
title Assessing Per-Sample Membership Inference Vulnerability without Retraining
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2602.15919