Maximizing Predictive Performance for Small Subgroups: Functionally Adaptive Interaction Regularization (FAIR)

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Smolyak, Daniel, Paulson, Courtney, Bjarnadóttir, Margrét V.
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913660657467392
author Smolyak, Daniel
Paulson, Courtney
Bjarnadóttir, Margrét V.
author_facet Smolyak, Daniel
Paulson, Courtney
Bjarnadóttir, Margrét V.
contents In many healthcare settings, it is both critical to consider fairness when building analytical applications but also uniquely unacceptable to lower model performance for one group to match that of another (e.g. fairness cannot be achieved by lowering the diagnostic ability of a model for one group to match that of another and lose overall diagnostic power). Therefore a modeler needs to maximize model performance across groups as much as possible, often while maintaining a model's interpretability, which is a challenge for a number of reasons. In this paper we therefore suggest a new modeling framework, FAIR, to maximize performance across imbalanced groups, based on existing linear regression approaches already commonly used in healthcare settings. We propose a full linear interaction model between groups and all other covariates, paired with a weighting of samples by group size and independent regularization penalties for each group. This efficient approach overcomes many of the limitations in current approaches and manages to balance learning from other groups with tailoring prediction to the small focal group(s). FAIR has an added advantage in that it still allows for model interpretability in research and clinical settings. We demonstrate its usefulness with numerical and health data experiments.
format Preprint
id arxiv_https___arxiv_org_abs_2412_20190
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Maximizing Predictive Performance for Small Subgroups: Functionally Adaptive Interaction Regularization (FAIR)
Smolyak, Daniel
Paulson, Courtney
Bjarnadóttir, Margrét V.
Applications
In many healthcare settings, it is both critical to consider fairness when building analytical applications but also uniquely unacceptable to lower model performance for one group to match that of another (e.g. fairness cannot be achieved by lowering the diagnostic ability of a model for one group to match that of another and lose overall diagnostic power). Therefore a modeler needs to maximize model performance across groups as much as possible, often while maintaining a model's interpretability, which is a challenge for a number of reasons. In this paper we therefore suggest a new modeling framework, FAIR, to maximize performance across imbalanced groups, based on existing linear regression approaches already commonly used in healthcare settings. We propose a full linear interaction model between groups and all other covariates, paired with a weighting of samples by group size and independent regularization penalties for each group. This efficient approach overcomes many of the limitations in current approaches and manages to balance learning from other groups with tailoring prediction to the small focal group(s). FAIR has an added advantage in that it still allows for model interpretability in research and clinical settings. We demonstrate its usefulness with numerical and health data experiments.
title Maximizing Predictive Performance for Small Subgroups: Functionally Adaptive Interaction Regularization (FAIR)
topic Applications
url https://arxiv.org/abs/2412.20190