A Fair Post-Processing Method based on the MADD Metric for Predictive Student Models
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909245734125568 |
|---|---|
| author | Verger, Mélina Fan, Chunyang Lallé, Sébastien Bouchet, François Luengo, Vanda |
| author_facet | Verger, Mélina Fan, Chunyang Lallé, Sébastien Bouchet, François Luengo, Vanda |
| contents | Predictive student models are increasingly used in learning environments. However, due to the rising social impact of their usage, it is now all the more important for these models to be both sufficiently accurate and fair in their predictions. To evaluate algorithmic fairness, a new metric has been developed in education, namely the Model Absolute Density Distance (MADD). This metric enables us to measure how different a predictive model behaves regarding two groups of students, in order to quantify its algorithmic unfairness. In this paper, we thus develop a post-processing method based on this metric, that aims at improving the fairness while preserving the accuracy of relevant predictive models' results. We experiment with our approach on the task of predicting student success in an online course, using both simulated and real-world educational data, and obtain successful results. Our source code and data are in open access at https://github.com/melinaverger/MADD . |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_05398 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Fair Post-Processing Method based on the MADD Metric for Predictive Student Models Verger, Mélina Fan, Chunyang Lallé, Sébastien Bouchet, François Luengo, Vanda Computers and Society Artificial Intelligence Discrete Mathematics Machine Learning Predictive student models are increasingly used in learning environments. However, due to the rising social impact of their usage, it is now all the more important for these models to be both sufficiently accurate and fair in their predictions. To evaluate algorithmic fairness, a new metric has been developed in education, namely the Model Absolute Density Distance (MADD). This metric enables us to measure how different a predictive model behaves regarding two groups of students, in order to quantify its algorithmic unfairness. In this paper, we thus develop a post-processing method based on this metric, that aims at improving the fairness while preserving the accuracy of relevant predictive models' results. We experiment with our approach on the task of predicting student success in an online course, using both simulated and real-world educational data, and obtain successful results. Our source code and data are in open access at https://github.com/melinaverger/MADD . |
| title | A Fair Post-Processing Method based on the MADD Metric for Predictive Student Models |
| topic | Computers and Society Artificial Intelligence Discrete Mathematics Machine Learning |
| url | https://arxiv.org/abs/2407.05398 |