Fairness Issues and Mitigations in (Differentially Private) Socio-Demographic Data Processes

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ko, Joonhyuk, Ziani, Juba, Das, Saswat, Williams, Matt, Fioretto, Ferdinando
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916570792460288
author Ko, Joonhyuk
Ziani, Juba
Das, Saswat
Williams, Matt
Fioretto, Ferdinando
author_facet Ko, Joonhyuk
Ziani, Juba
Das, Saswat
Williams, Matt
Fioretto, Ferdinando
contents Statistical agencies rely on sampling techniques to collect socio-demographic data crucial for policy-making and resource allocation. This paper shows that surveys of important societal relevance introduce sampling errors that unevenly impact group-level estimates, thereby compromising fairness in downstream decisions. To address these issues, this paper introduces an optimization approach modeled on real-world survey design processes, ensuring sampling costs are optimized while maintaining error margins within prescribed tolerances. Additionally, privacy-preserving methods used to determine sampling rates can further impact these fairness issues. This paper explores the impact of differential privacy on the statistics informing the sampling process, revealing a surprising effect: not only is the expected negative effect from the addition of noise for differential privacy negligible, but also this privacy noise can in fact reduce unfairness as it positively biases smaller counts. These findings are validated over an extensive analysis using datasets commonly applied in census statistics.
format Preprint
id arxiv_https___arxiv_org_abs_2408_08471
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Fairness Issues and Mitigations in (Differentially Private) Socio-Demographic Data Processes
Ko, Joonhyuk
Ziani, Juba
Das, Saswat
Williams, Matt
Fioretto, Ferdinando
Cryptography and Security
Artificial Intelligence
Computers and Society
Statistical agencies rely on sampling techniques to collect socio-demographic data crucial for policy-making and resource allocation. This paper shows that surveys of important societal relevance introduce sampling errors that unevenly impact group-level estimates, thereby compromising fairness in downstream decisions. To address these issues, this paper introduces an optimization approach modeled on real-world survey design processes, ensuring sampling costs are optimized while maintaining error margins within prescribed tolerances. Additionally, privacy-preserving methods used to determine sampling rates can further impact these fairness issues. This paper explores the impact of differential privacy on the statistics informing the sampling process, revealing a surprising effect: not only is the expected negative effect from the addition of noise for differential privacy negligible, but also this privacy noise can in fact reduce unfairness as it positively biases smaller counts. These findings are validated over an extensive analysis using datasets commonly applied in census statistics.
title Fairness Issues and Mitigations in (Differentially Private) Socio-Demographic Data Processes
topic Cryptography and Security
Artificial Intelligence
Computers and Society
url https://arxiv.org/abs/2408.08471