This Probably Looks Exactly Like That: An Invertible Prototypical Network
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916327988396032 |
|---|---|
| author | Carmichael, Zachariah Redgrave, Timothy Cedre, Daniel Gonzalez Scheirer, Walter J. |
| author_facet | Carmichael, Zachariah Redgrave, Timothy Cedre, Daniel Gonzalez Scheirer, Walter J. |
| contents | We combine concept-based neural networks with generative, flow-based classifiers into a novel, intrinsically explainable, exactly invertible approach to supervised learning. Prototypical neural networks, a type of concept-based neural network, represent an exciting way forward in realizing human-comprehensible machine learning without concept annotations, but a human-machine semantic gap continues to haunt current approaches. We find that reliance on indirect interpretation functions for prototypical explanations imposes a severe limit on prototypes' informative power. From this, we posit that invertibly learning prototypes as distributions over the latent space provides more robust, expressive, and interpretable modeling. We propose one such model, called ProtoFlow, by composing a normalizing flow with Gaussian mixture models. ProtoFlow (1) sets a new state-of-the-art in joint generative and predictive modeling and (2) achieves predictive performance comparable to existing prototypical neural networks while enabling richer interpretation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_12200 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | This Probably Looks Exactly Like That: An Invertible Prototypical Network Carmichael, Zachariah Redgrave, Timothy Cedre, Daniel Gonzalez Scheirer, Walter J. Machine Learning Artificial Intelligence We combine concept-based neural networks with generative, flow-based classifiers into a novel, intrinsically explainable, exactly invertible approach to supervised learning. Prototypical neural networks, a type of concept-based neural network, represent an exciting way forward in realizing human-comprehensible machine learning without concept annotations, but a human-machine semantic gap continues to haunt current approaches. We find that reliance on indirect interpretation functions for prototypical explanations imposes a severe limit on prototypes' informative power. From this, we posit that invertibly learning prototypes as distributions over the latent space provides more robust, expressive, and interpretable modeling. We propose one such model, called ProtoFlow, by composing a normalizing flow with Gaussian mixture models. ProtoFlow (1) sets a new state-of-the-art in joint generative and predictive modeling and (2) achieves predictive performance comparable to existing prototypical neural networks while enabling richer interpretation. |
| title | This Probably Looks Exactly Like That: An Invertible Prototypical Network |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2407.12200 |