Attribution-Guided Model Rectification of Unreliable Neural Network Behaviors

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Yang, Peiyu, Akhtar, Naveed, Jiang, Jiantong, Mian, Ajmal
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908890912784384
author Yang, Peiyu
Akhtar, Naveed
Jiang, Jiantong
Mian, Ajmal
author_facet Yang, Peiyu
Akhtar, Naveed
Jiang, Jiantong
Mian, Ajmal
contents The performance of neural network models deteriorates due to their unreliable behavior on non-robust features of corrupted samples. Owing to their opaque nature, rectifying models to address this problem often necessitates arduous data cleaning and model retraining, resulting in huge computational and manual overhead. In this work, we leverage rank-one model editing to establish an attribution-guided model rectification framework that effectively locates and corrects model unreliable behaviors. We first distinguish our rectification setting from existing model editing, yielding a formulation that corrects unreliable behavior while preserving model performance and reducing reliance on large budgets of cleansed samples. We further reveal a bottleneck of model rectifying arising from heterogeneous editability across layers. To target the primary source of misbehavior, we introduce an attribution-guided layer localization method that quantifies layer-wise editability and identifies the layer most responsible for unreliabilities. Extensive experiments demonstrate the effectiveness of our method in correcting unreliabilities observed for neural Trojans, spurious correlations and feature leakage. Our method shows remarkable performance by achieving its editing objective with as few as a single cleansed sample, which makes it appealing for practice.
format Preprint
id arxiv_https___arxiv_org_abs_2603_15656
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Attribution-Guided Model Rectification of Unreliable Neural Network Behaviors
Yang, Peiyu
Akhtar, Naveed
Jiang, Jiantong
Mian, Ajmal
Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
The performance of neural network models deteriorates due to their unreliable behavior on non-robust features of corrupted samples. Owing to their opaque nature, rectifying models to address this problem often necessitates arduous data cleaning and model retraining, resulting in huge computational and manual overhead. In this work, we leverage rank-one model editing to establish an attribution-guided model rectification framework that effectively locates and corrects model unreliable behaviors. We first distinguish our rectification setting from existing model editing, yielding a formulation that corrects unreliable behavior while preserving model performance and reducing reliance on large budgets of cleansed samples. We further reveal a bottleneck of model rectifying arising from heterogeneous editability across layers. To target the primary source of misbehavior, we introduce an attribution-guided layer localization method that quantifies layer-wise editability and identifies the layer most responsible for unreliabilities. Extensive experiments demonstrate the effectiveness of our method in correcting unreliabilities observed for neural Trojans, spurious correlations and feature leakage. Our method shows remarkable performance by achieving its editing objective with as few as a single cleansed sample, which makes it appealing for practice.
title Attribution-Guided Model Rectification of Unreliable Neural Network Behaviors
topic Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.15656