Runtime Monitoring and Enforcement of Conditional Fairness in Generative AIs
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908484064247808 |
|---|---|
| author | Cheng, Chih-Hong Wu, Changshun Zhao, Xingyu Bensalem, Saddek Ruess, Harald |
| author_facet | Cheng, Chih-Hong Wu, Changshun Zhao, Xingyu Bensalem, Saddek Ruess, Harald |
| contents | The deployment of generative AI (GenAI) models raises significant fairness concerns, addressed in this paper through novel characterization and enforcement techniques specific to GenAI. Unlike standard AI performing specific tasks, GenAI's broad functionality requires ``conditional fairness'' tailored to the context being generated, such as demographic fairness in generating images of poor people versus successful business leaders. We define two fairness levels: the first evaluates fairness in generated outputs, independent of prompts and models; the second assesses inherent fairness with neutral prompts. Given the complexity of GenAI and challenges in fairness specifications, we focus on bounding the worst case, considering a GenAI system unfair if the distance between appearances of a specific group exceeds preset thresholds. We also explore combinatorial testing for assessing relative completeness in intersectional fairness. By bounding the worst case, we develop a prompt injection scheme within an agent-based framework to enforce conditional fairness with minimal intervention, validated on state-of-the-art GenAI systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_16663 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Runtime Monitoring and Enforcement of Conditional Fairness in Generative AIs Cheng, Chih-Hong Wu, Changshun Zhao, Xingyu Bensalem, Saddek Ruess, Harald Machine Learning Artificial Intelligence Computers and Society Logic in Computer Science Software Engineering The deployment of generative AI (GenAI) models raises significant fairness concerns, addressed in this paper through novel characterization and enforcement techniques specific to GenAI. Unlike standard AI performing specific tasks, GenAI's broad functionality requires ``conditional fairness'' tailored to the context being generated, such as demographic fairness in generating images of poor people versus successful business leaders. We define two fairness levels: the first evaluates fairness in generated outputs, independent of prompts and models; the second assesses inherent fairness with neutral prompts. Given the complexity of GenAI and challenges in fairness specifications, we focus on bounding the worst case, considering a GenAI system unfair if the distance between appearances of a specific group exceeds preset thresholds. We also explore combinatorial testing for assessing relative completeness in intersectional fairness. By bounding the worst case, we develop a prompt injection scheme within an agent-based framework to enforce conditional fairness with minimal intervention, validated on state-of-the-art GenAI systems. |
| title | Runtime Monitoring and Enforcement of Conditional Fairness in Generative AIs |
| topic | Machine Learning Artificial Intelligence Computers and Society Logic in Computer Science Software Engineering |
| url | https://arxiv.org/abs/2404.16663 |