Diverse Prototypical Ensembles Improve Robustness to Subpopulation Shift
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909626572734464 |
|---|---|
| author | To, Minh Nguyen Nhat RWilson, Paul F Nguyen, Viet Harmanani, Mohamed Cooper, Michael Fooladgar, Fahimeh Abolmaesumi, Purang Mousavi, Parvin Krishnan, Rahul G. |
| author_facet | To, Minh Nguyen Nhat RWilson, Paul F Nguyen, Viet Harmanani, Mohamed Cooper, Michael Fooladgar, Fahimeh Abolmaesumi, Purang Mousavi, Parvin Krishnan, Rahul G. |
| contents | The subpopulationtion shift, characterized by a disparity in subpopulation distributibetween theween the training and target datasets, can significantly degrade the performance of machine learning models. Current solutions to subpopulation shift involve modifying empirical risk minimization with re-weighting strategies to improve generalization. This strategy relies on assumptions about the number and nature of subpopulations and annotations on group membership, which are unavailable for many real-world datasets. Instead, we propose using an ensemble of diverse classifiers to adaptively capture risk associated with subpopulations. Given a feature extractor network, we replace its standard linear classification layer with a mixture of prototypical classifiers, where each member is trained to classify the data while focusing on different features and samples from other members. In empirical evaluation on nine real-world datasets, covering diverse domains and kinds of subpopulation shift, our method of Diverse Prototypical Ensembles (DPEs) often outperforms the prior state-of-the-art in worst-group accuracy. The code is available at https://github.com/minhto2802/dpe4subpop |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_23027 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Diverse Prototypical Ensembles Improve Robustness to Subpopulation Shift To, Minh Nguyen Nhat RWilson, Paul F Nguyen, Viet Harmanani, Mohamed Cooper, Michael Fooladgar, Fahimeh Abolmaesumi, Purang Mousavi, Parvin Krishnan, Rahul G. Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition The subpopulationtion shift, characterized by a disparity in subpopulation distributibetween theween the training and target datasets, can significantly degrade the performance of machine learning models. Current solutions to subpopulation shift involve modifying empirical risk minimization with re-weighting strategies to improve generalization. This strategy relies on assumptions about the number and nature of subpopulations and annotations on group membership, which are unavailable for many real-world datasets. Instead, we propose using an ensemble of diverse classifiers to adaptively capture risk associated with subpopulations. Given a feature extractor network, we replace its standard linear classification layer with a mixture of prototypical classifiers, where each member is trained to classify the data while focusing on different features and samples from other members. In empirical evaluation on nine real-world datasets, covering diverse domains and kinds of subpopulation shift, our method of Diverse Prototypical Ensembles (DPEs) often outperforms the prior state-of-the-art in worst-group accuracy. The code is available at https://github.com/minhto2802/dpe4subpop |
| title | Diverse Prototypical Ensembles Improve Robustness to Subpopulation Shift |
| topic | Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2505.23027 |