Hidden Monotonicity: Explaining Deep Neural Networks via their DC Decomposition

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Zimmermann, Jakob Paul, Loho, Georg
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911375877472256
author Zimmermann, Jakob Paul
Loho, Georg
author_facet Zimmermann, Jakob Paul
Loho, Georg
contents It has been demonstrated in various contexts that monotonicity leads to better explainability in neural networks. However, not every function can be well approximated by a monotone neural network. We demonstrate that monotonicity can still be used in two ways to boost explainability. First, we use an adaptation of the decomposition of a trained ReLU network into two monotone and convex parts, thereby overcoming numerical obstacles from an inherent blowup of the weights in this procedure. Our proposed saliency methods - SplitCAM and SplitLRP - improve on state of the art results on both VGG16 and Resnet18 networks on ImageNet-S across all Quantus saliency metric categories. Second, we exhibit that training a model as the difference between two monotone neural networks results in a system with strong self-explainability properties.
format Preprint
id arxiv_https___arxiv_org_abs_2601_07700
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Hidden Monotonicity: Explaining Deep Neural Networks via their DC Decomposition
Zimmermann, Jakob Paul
Loho, Georg
Computer Vision and Pattern Recognition
Machine Learning
It has been demonstrated in various contexts that monotonicity leads to better explainability in neural networks. However, not every function can be well approximated by a monotone neural network. We demonstrate that monotonicity can still be used in two ways to boost explainability. First, we use an adaptation of the decomposition of a trained ReLU network into two monotone and convex parts, thereby overcoming numerical obstacles from an inherent blowup of the weights in this procedure. Our proposed saliency methods - SplitCAM and SplitLRP - improve on state of the art results on both VGG16 and Resnet18 networks on ImageNet-S across all Quantus saliency metric categories. Second, we exhibit that training a model as the difference between two monotone neural networks results in a system with strong self-explainability properties.
title Hidden Monotonicity: Explaining Deep Neural Networks via their DC Decomposition
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2601.07700