Analysis and Explainability of LLMs Via Evolutionary Methods
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910190610153472 |
|---|---|
| author | Gallagher, Shannon K. Rallapalli, Swati Brooks, Tyler Loughin, Chuck Sezgin, Michele Yurko, Ronald |
| author_facet | Gallagher, Shannon K. Rallapalli, Swati Brooks, Tyler Loughin, Chuck Sezgin, Michele Yurko, Ronald |
| contents | Evolutionary methods have long been useful for analysis and explanation in genetics, biology, ecology, and related fields. In this work, we extend these methods to neural networks, specifically large language models (LLMs), to better analyze and explain relationships among models. We show how relating weights to genotypes and output text to phenotypes can improve our understanding of model lineage, important datasets, the roles of different model layers, and visualization of model relationships. We demonstrate this in a controlled experiment, where our estimated evolutionary trees reliably recover the topology of the ground-truth training tree. We further identify the most important weight layers according to weight differences and show through phenotypic experiments that one training dataset appears to contribute more useful information than the others. Finally, we generate an unsupervised evolutionary tree of black-box foundation models. Throughout, we provide visualizations that support a clearer understanding of evolutionary relationships among LLMs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_02930 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Analysis and Explainability of LLMs Via Evolutionary Methods Gallagher, Shannon K. Rallapalli, Swati Brooks, Tyler Loughin, Chuck Sezgin, Michele Yurko, Ronald Neural and Evolutionary Computing Machine Learning Evolutionary methods have long been useful for analysis and explanation in genetics, biology, ecology, and related fields. In this work, we extend these methods to neural networks, specifically large language models (LLMs), to better analyze and explain relationships among models. We show how relating weights to genotypes and output text to phenotypes can improve our understanding of model lineage, important datasets, the roles of different model layers, and visualization of model relationships. We demonstrate this in a controlled experiment, where our estimated evolutionary trees reliably recover the topology of the ground-truth training tree. We further identify the most important weight layers according to weight differences and show through phenotypic experiments that one training dataset appears to contribute more useful information than the others. Finally, we generate an unsupervised evolutionary tree of black-box foundation models. Throughout, we provide visualizations that support a clearer understanding of evolutionary relationships among LLMs. |
| title | Analysis and Explainability of LLMs Via Evolutionary Methods |
| topic | Neural and Evolutionary Computing Machine Learning |
| url | https://arxiv.org/abs/2605.02930 |