DLBacktrace: A Model Agnostic Explainability for any Deep Learning Models

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Sankarapu, Vinay Kumar, Chitroda, Chintan, Rathore, Yashwardhan, Singh, Neeraj Kumar, Seth, Pratinav
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910813173841920
author Sankarapu, Vinay Kumar
Chitroda, Chintan
Rathore, Yashwardhan
Singh, Neeraj Kumar
Seth, Pratinav
author_facet Sankarapu, Vinay Kumar
Chitroda, Chintan
Rathore, Yashwardhan
Singh, Neeraj Kumar
Seth, Pratinav
contents The rapid growth of AI has led to more complex deep learning models, often operating as opaque "black boxes" with limited transparency in their decision-making. This lack of interpretability poses challenges, especially in high-stakes applications where understanding model output is crucial. This work highlights the importance of interpretability in fostering trust, accountability, and responsible deployment. To address these challenges, we introduce DLBacktrace, a novel, model-agnostic technique designed to provide clear insights into deep learning model decisions across a wide range of domains and architectures, including MLPs, CNNs, and Transformer-based LLM models. We present a comprehensive overview of DLBacktrace and benchmark its performance against established interpretability methods such as SHAP, LIME, and GradCAM. Our results demonstrate that DLBacktrace effectively enhances understanding of model behavior across diverse tasks. DLBacktrace is compatible with models developed in both PyTorch and TensorFlow, supporting architectures such as BERT, ResNet, U-Net, and custom DNNs for tabular data. The library is open-sourced and available at https://github.com/AryaXAI/DLBacktrace .
format Preprint
id arxiv_https___arxiv_org_abs_2411_12643
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle DLBacktrace: A Model Agnostic Explainability for any Deep Learning Models
Sankarapu, Vinay Kumar
Chitroda, Chintan
Rathore, Yashwardhan
Singh, Neeraj Kumar
Seth, Pratinav
Machine Learning
Artificial Intelligence
Computation and Language
The rapid growth of AI has led to more complex deep learning models, often operating as opaque "black boxes" with limited transparency in their decision-making. This lack of interpretability poses challenges, especially in high-stakes applications where understanding model output is crucial. This work highlights the importance of interpretability in fostering trust, accountability, and responsible deployment. To address these challenges, we introduce DLBacktrace, a novel, model-agnostic technique designed to provide clear insights into deep learning model decisions across a wide range of domains and architectures, including MLPs, CNNs, and Transformer-based LLM models. We present a comprehensive overview of DLBacktrace and benchmark its performance against established interpretability methods such as SHAP, LIME, and GradCAM. Our results demonstrate that DLBacktrace effectively enhances understanding of model behavior across diverse tasks. DLBacktrace is compatible with models developed in both PyTorch and TensorFlow, supporting architectures such as BERT, ResNet, U-Net, and custom DNNs for tabular data. The library is open-sourced and available at https://github.com/AryaXAI/DLBacktrace .
title DLBacktrace: A Model Agnostic Explainability for any Deep Learning Models
topic Machine Learning
Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2411.12643