Equilibrium Dynamics and Mitigation of Gender Bias in Synthetically Generated Data
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911264254459904 |
|---|---|
| author | Kattamuri, Ashish Vats, Arpita Fartale, Harshwardhan Raja, Rahul Moharir, Akshata Kishore Prasad, Ishita |
| author_facet | Kattamuri, Ashish Vats, Arpita Fartale, Harshwardhan Raja, Rahul Moharir, Akshata Kishore Prasad, Ishita |
| contents | Recursive prompting with large language models enables scalable synthetic dataset generation but introduces the risk of bias amplification. We investigate gender bias dynamics across three generations of recursive text generation using three complementary evaluation frameworks: rule-based pattern matching, embedding-based semantic similarity, and downstream task performance. Experiments with three initial bias levels (0.1, 0.3, 0.6) and four mitigation strategies reveal equilibrium dynamics rather than monotonic amplification. The low initial bias amplifies toward the model's inherent bias level (+36%), whereas the high initial bias decays toward it (-26%). Among mitigation methods, contrastive augmentation, which introduces gender-swapped variants, achieves significant downstream bias reduction (98.8% for low initial bias and 91% on average) despite producing higher embedding-based bias scores. This paradox demonstrates that semantic similarity metrics may diverge from behavioral fairness outcomes, highlighting the need for multidimensional evaluation in responsible synthetic data generation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_10689 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Equilibrium Dynamics and Mitigation of Gender Bias in Synthetically Generated Data Kattamuri, Ashish Vats, Arpita Fartale, Harshwardhan Raja, Rahul Moharir, Akshata Kishore Prasad, Ishita Computation and Language Artificial Intelligence Recursive prompting with large language models enables scalable synthetic dataset generation but introduces the risk of bias amplification. We investigate gender bias dynamics across three generations of recursive text generation using three complementary evaluation frameworks: rule-based pattern matching, embedding-based semantic similarity, and downstream task performance. Experiments with three initial bias levels (0.1, 0.3, 0.6) and four mitigation strategies reveal equilibrium dynamics rather than monotonic amplification. The low initial bias amplifies toward the model's inherent bias level (+36%), whereas the high initial bias decays toward it (-26%). Among mitigation methods, contrastive augmentation, which introduces gender-swapped variants, achieves significant downstream bias reduction (98.8% for low initial bias and 91% on average) despite producing higher embedding-based bias scores. This paradox demonstrates that semantic similarity metrics may diverge from behavioral fairness outcomes, highlighting the need for multidimensional evaluation in responsible synthetic data generation. |
| title | Equilibrium Dynamics and Mitigation of Gender Bias in Synthetically Generated Data |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2511.10689 |