Deep Model Interpretation with Limited Data : A Coreset-based Approach

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Behzadi-Khormouji, Hamed, Oramas, José
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914964542849024
author Behzadi-Khormouji, Hamed
Oramas, José
author_facet Behzadi-Khormouji, Hamed
Oramas, José
contents Model Interpretation aims at the extraction of insights from the internals of a trained model. A common approach to address this task is the characterization of relevant features internally encoded in the model that are critical for its proper operation. Despite recent progress of these methods, they come with the weakness of being computationally expensive due to the dense evaluation of datasets that they require. As a consequence, research on the design of these methods have focused on smaller data subsets which may led to reduced insights. To address these computational costs, we propose a coreset-based interpretation framework that utilizes coreset selection methods to sample a representative subset of the large dataset for the interpretation task. Towards this goal, we propose a similarity-based evaluation protocol to assess the robustness of model interpretation methods towards the amount data they take as input. Experiments considering several interpretation methods, DNN models, and coreset selection methods show the effectiveness of the proposed framework.
format Preprint
id arxiv_https___arxiv_org_abs_2410_00524
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Deep Model Interpretation with Limited Data : A Coreset-based Approach
Behzadi-Khormouji, Hamed
Oramas, José
Machine Learning
Computer Vision and Pattern Recognition
Model Interpretation aims at the extraction of insights from the internals of a trained model. A common approach to address this task is the characterization of relevant features internally encoded in the model that are critical for its proper operation. Despite recent progress of these methods, they come with the weakness of being computationally expensive due to the dense evaluation of datasets that they require. As a consequence, research on the design of these methods have focused on smaller data subsets which may led to reduced insights. To address these computational costs, we propose a coreset-based interpretation framework that utilizes coreset selection methods to sample a representative subset of the large dataset for the interpretation task. Towards this goal, we propose a similarity-based evaluation protocol to assess the robustness of model interpretation methods towards the amount data they take as input. Experiments considering several interpretation methods, DNN models, and coreset selection methods show the effectiveness of the proposed framework.
title Deep Model Interpretation with Limited Data : A Coreset-based Approach
topic Machine Learning
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2410.00524