Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2403.14200 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909261951401984 |
|---|---|
| author | Nahon, Rémi Matos, Ivan Luiz De Moura Nguyen, Van-Tam Tartaglione, Enzo |
| author_facet | Nahon, Rémi Matos, Ivan Luiz De Moura Nguyen, Van-Tam Tartaglione, Enzo |
| contents | Nowadays an ever-growing concerning phenomenon, the emergence of algorithmic biases that can lead to unfair models, emerges. Several debiasing approaches have been proposed in the realm of deep learning, employing more or less sophisticated approaches to discourage these models from massively employing these biases. However, a question emerges: is this extra complexity really necessary? Is a vanilla-trained model already embodying some ``unbiased sub-networks'' that can be used in isolation and propose a solution without relying on the algorithmic biases? In this work, we show that such a sub-network typically exists, and can be extracted from a vanilla-trained model without requiring additional training. We further validate that such specific architecture is incapable of learning a specific bias, suggesting that there are possible architectural countermeasures to the problem of biases in deep neural networks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_14200 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Debiasing surgeon: fantastic weights and how to find them Nahon, Rémi Matos, Ivan Luiz De Moura Nguyen, Van-Tam Tartaglione, Enzo Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition Computers and Society Nowadays an ever-growing concerning phenomenon, the emergence of algorithmic biases that can lead to unfair models, emerges. Several debiasing approaches have been proposed in the realm of deep learning, employing more or less sophisticated approaches to discourage these models from massively employing these biases. However, a question emerges: is this extra complexity really necessary? Is a vanilla-trained model already embodying some ``unbiased sub-networks'' that can be used in isolation and propose a solution without relying on the algorithmic biases? In this work, we show that such a sub-network typically exists, and can be extracted from a vanilla-trained model without requiring additional training. We further validate that such specific architecture is incapable of learning a specific bias, suggesting that there are possible architectural countermeasures to the problem of biases in deep neural networks. |
| title | Debiasing surgeon: fantastic weights and how to find them |
| topic | Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition Computers and Society |
| url | https://arxiv.org/abs/2403.14200 |