Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2501.15638 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912719417901056 |
|---|---|
| author | Ji, Yang Sun, Ying Zhang, Yuting Wang, Zhigaoyuan Zhuang, Yuanxin Gong, Zheng Shen, Dazhong Qin, Chuan Zhu, Hengshu Xiong, Hui |
| author_facet | Ji, Yang Sun, Ying Zhang, Yuting Wang, Zhigaoyuan Zhuang, Yuanxin Gong, Zheng Shen, Dazhong Qin, Chuan Zhu, Hengshu Xiong, Hui |
| contents | Neural networks have achieved remarkable success across various fields. However, the lack of interpretability limits their practical use, particularly in critical decision-making scenarios. Post-hoc interpretability, which provides explanations for pre-trained models, is often at risk of robustness and fidelity. This has inspired a rising interest in self-interpretable neural networks, which inherently reveal the prediction rationale through the model structures. Although there exist surveys on post-hoc interpretability, a comprehensive and systematic survey of self-interpretable neural networks is still missing. To address this gap, we first collect and review existing works on self-interpretable neural networks and provide a structured summary of their methodologies from five key perspectives: attribution-based, function-based, concept-based, prototype-based, and rule-based self-interpretation. We also present concrete, visualized examples of model explanations and discuss their applicability across diverse scenarios, including image, text, graph data, and deep reinforcement learning. Additionally, we summarize existing evaluation metrics for self-interpretability and identify open challenges in this field, offering insights for future research. To support ongoing developments, we present a publicly accessible resource to track advancements in this domain: https://github.com/yangji721/Awesome-Self-Interpretable-Neural-Network. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_15638 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A Comprehensive Survey on Self-Interpretable Neural Networks Ji, Yang Sun, Ying Zhang, Yuting Wang, Zhigaoyuan Zhuang, Yuanxin Gong, Zheng Shen, Dazhong Qin, Chuan Zhu, Hengshu Xiong, Hui Machine Learning Artificial Intelligence Neural networks have achieved remarkable success across various fields. However, the lack of interpretability limits their practical use, particularly in critical decision-making scenarios. Post-hoc interpretability, which provides explanations for pre-trained models, is often at risk of robustness and fidelity. This has inspired a rising interest in self-interpretable neural networks, which inherently reveal the prediction rationale through the model structures. Although there exist surveys on post-hoc interpretability, a comprehensive and systematic survey of self-interpretable neural networks is still missing. To address this gap, we first collect and review existing works on self-interpretable neural networks and provide a structured summary of their methodologies from five key perspectives: attribution-based, function-based, concept-based, prototype-based, and rule-based self-interpretation. We also present concrete, visualized examples of model explanations and discuss their applicability across diverse scenarios, including image, text, graph data, and deep reinforcement learning. Additionally, we summarize existing evaluation metrics for self-interpretability and identify open challenges in this field, offering insights for future research. To support ongoing developments, we present a publicly accessible resource to track advancements in this domain: https://github.com/yangji721/Awesome-Self-Interpretable-Neural-Network. |
| title | A Comprehensive Survey on Self-Interpretable Neural Networks |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2501.15638 |