P2NIA: Privacy-Preserving Non-Iterative Auditing

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Bourrée, Jade Garcia, Lautraite, Hadrien, Gambs, Sébastien, Tredan, Gilles, Merrer, Erwan Le, Rottembourg, Benoît
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912303977332736
author Bourrée, Jade Garcia
Lautraite, Hadrien
Gambs, Sébastien
Tredan, Gilles
Merrer, Erwan Le
Rottembourg, Benoît
author_facet Bourrée, Jade Garcia
Lautraite, Hadrien
Gambs, Sébastien
Tredan, Gilles
Merrer, Erwan Le
Rottembourg, Benoît
contents The emergence of AI legislation has increased the need to assess the ethical compliance of high-risk AI systems. Traditional auditing methods rely on platforms' application programming interfaces (APIs), where responses to queries are examined through the lens of fairness requirements. However, such approaches put a significant burden on platforms, as they are forced to maintain APIs while ensuring privacy, facing the possibility of data leaks. This lack of proper collaboration between the two parties, in turn, causes a significant challenge to the auditor, who is subject to estimation bias as they are unaware of the data distribution of the platform. To address these two issues, we present P2NIA, a novel auditing scheme that proposes a mutually beneficial collaboration for both the auditor and the platform. Extensive experiments demonstrate P2NIA's effectiveness in addressing both issues. In summary, our work introduces a privacy-preserving and non-iterative audit scheme that enhances fairness assessments using synthetic or local data, avoiding the challenges associated with traditional API-based audits.
format Preprint
id arxiv_https___arxiv_org_abs_2504_00874
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle P2NIA: Privacy-Preserving Non-Iterative Auditing
Bourrée, Jade Garcia
Lautraite, Hadrien
Gambs, Sébastien
Tredan, Gilles
Merrer, Erwan Le
Rottembourg, Benoît
Machine Learning
The emergence of AI legislation has increased the need to assess the ethical compliance of high-risk AI systems. Traditional auditing methods rely on platforms' application programming interfaces (APIs), where responses to queries are examined through the lens of fairness requirements. However, such approaches put a significant burden on platforms, as they are forced to maintain APIs while ensuring privacy, facing the possibility of data leaks. This lack of proper collaboration between the two parties, in turn, causes a significant challenge to the auditor, who is subject to estimation bias as they are unaware of the data distribution of the platform. To address these two issues, we present P2NIA, a novel auditing scheme that proposes a mutually beneficial collaboration for both the auditor and the platform. Extensive experiments demonstrate P2NIA's effectiveness in addressing both issues. In summary, our work introduces a privacy-preserving and non-iterative audit scheme that enhances fairness assessments using synthetic or local data, avoiding the challenges associated with traditional API-based audits.
title P2NIA: Privacy-Preserving Non-Iterative Auditing
topic Machine Learning
url https://arxiv.org/abs/2504.00874