Leveraging Black-box Models to Assess Feature Importance in Unconditional Distribution

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhou, Jing, Li, Chunlin
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916513072545792
author Zhou, Jing
Li, Chunlin
author_facet Zhou, Jing
Li, Chunlin
contents Understanding how changes in explanatory features affect the unconditional distribution of the outcome is important in many applications. However, existing black-box predictive models are not readily suited for analyzing such questions. In this work, we develop an approximation method to compute the feature importance curves relevant to the unconditional distribution of outcomes, while leveraging the power of pre-trained black-box predictive models. The feature importance curves measure the changes across quantiles of outcome distribution given an external impact of change in the explanatory features. Through extensive numerical experiments and real data examples, we demonstrate that our approximation method produces sparse and faithful results, and is computationally efficient.
format Preprint
id arxiv_https___arxiv_org_abs_2412_05759
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Leveraging Black-box Models to Assess Feature Importance in Unconditional Distribution
Zhou, Jing
Li, Chunlin
Machine Learning
Computation
Methodology
Understanding how changes in explanatory features affect the unconditional distribution of the outcome is important in many applications. However, existing black-box predictive models are not readily suited for analyzing such questions. In this work, we develop an approximation method to compute the feature importance curves relevant to the unconditional distribution of outcomes, while leveraging the power of pre-trained black-box predictive models. The feature importance curves measure the changes across quantiles of outcome distribution given an external impact of change in the explanatory features. Through extensive numerical experiments and real data examples, we demonstrate that our approximation method produces sparse and faithful results, and is computationally efficient.
title Leveraging Black-box Models to Assess Feature Importance in Unconditional Distribution
topic Machine Learning
Computation
Methodology
url https://arxiv.org/abs/2412.05759