Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2504.01771 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916672042958848 |
|---|---|
| author | Aivalis, Theodoros Klampanos, Iraklis A. Troumpoukis, Antonis Jose, Joemon M. |
| author_facet | Aivalis, Theodoros Klampanos, Iraklis A. Troumpoukis, Antonis Jose, Joemon M. |
| contents | Generative AI models offer powerful capabilities but often lack transparency, making it difficult to interpret their output. This is critical in cases involving artistic or copyrighted content. This work introduces a search-inspired approach to improve the interpretability of these models by analysing the influence of training data on their outputs. Our method provides observational interpretability by focusing on a model's output rather than on its internal state. We consider both raw data and latent-space embeddings when searching for the influence of data items in generated content. We evaluate our method by retraining models locally and by demonstrating the method's ability to uncover influential subsets in the training data. This work lays the groundwork for future extensions, including user-based evaluations with domain experts, which is expected to improve observational interpretability further. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_01771 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Enhancing Interpretability in Generative AI Through Search-Based Data Influence Analysis Aivalis, Theodoros Klampanos, Iraklis A. Troumpoukis, Antonis Jose, Joemon M. Artificial Intelligence Machine Learning Generative AI models offer powerful capabilities but often lack transparency, making it difficult to interpret their output. This is critical in cases involving artistic or copyrighted content. This work introduces a search-inspired approach to improve the interpretability of these models by analysing the influence of training data on their outputs. Our method provides observational interpretability by focusing on a model's output rather than on its internal state. We consider both raw data and latent-space embeddings when searching for the influence of data items in generated content. We evaluate our method by retraining models locally and by demonstrating the method's ability to uncover influential subsets in the training data. This work lays the groundwork for future extensions, including user-based evaluations with domain experts, which is expected to improve observational interpretability further. |
| title | Enhancing Interpretability in Generative AI Through Search-Based Data Influence Analysis |
| topic | Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2504.01771 |