Graph Concept Bottleneck Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xu, Haotian, Weng, Tsui-Wei, Nguyen, Lam M., Ma, Tengfei
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915971276472320
author Xu, Haotian
Weng, Tsui-Wei
Nguyen, Lam M.
Ma, Tengfei
author_facet Xu, Haotian
Weng, Tsui-Wei
Nguyen, Lam M.
Ma, Tengfei
contents Concept Bottleneck Models (CBMs) provide explicit interpretations for deep neural networks through concepts and allow intervention with concepts to adjust final predictions. Existing CBMs assume concepts are conditionally independent given labels and isolated from each other, ignoring the hidden relationships among concepts. However, the set of concepts in CBMs often has an intrinsic structure where concepts are generally correlated: changing one concept will inherently impact its related concepts. To mitigate this limitation, we propose GraphCBMs: a new variant of CBM that facilitates concept relationships by constructing latent concept graphs, which can be combined with CBMs to enhance model performance while retaining their interpretability. Our experiment results on real-world image classification tasks demonstrate Graph CBMs offer the following benefits: (1) superior in image classification tasks while providing more concept structure information for interpretability; (2) able to utilize latent concept graphs for more effective interventions; and (3) robust in performance across different training and architecture settings.
format Preprint
id arxiv_https___arxiv_org_abs_2508_14255
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Graph Concept Bottleneck Models
Xu, Haotian
Weng, Tsui-Wei
Nguyen, Lam M.
Ma, Tengfei
Machine Learning
Concept Bottleneck Models (CBMs) provide explicit interpretations for deep neural networks through concepts and allow intervention with concepts to adjust final predictions. Existing CBMs assume concepts are conditionally independent given labels and isolated from each other, ignoring the hidden relationships among concepts. However, the set of concepts in CBMs often has an intrinsic structure where concepts are generally correlated: changing one concept will inherently impact its related concepts. To mitigate this limitation, we propose GraphCBMs: a new variant of CBM that facilitates concept relationships by constructing latent concept graphs, which can be combined with CBMs to enhance model performance while retaining their interpretability. Our experiment results on real-world image classification tasks demonstrate Graph CBMs offer the following benefits: (1) superior in image classification tasks while providing more concept structure information for interpretability; (2) able to utilize latent concept graphs for more effective interventions; and (3) robust in performance across different training and architecture settings.
title Graph Concept Bottleneck Models
topic Machine Learning
url https://arxiv.org/abs/2508.14255