Category-Theoretical and Topos-Theoretical Frameworks in Machine Learning: A Survey

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Jia, Yiyang, Peng, Guohong, Yang, Zheng, Chen, Tianhao
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913675148787712
author Jia, Yiyang
Peng, Guohong
Yang, Zheng
Chen, Tianhao
author_facet Jia, Yiyang
Peng, Guohong
Yang, Zheng
Chen, Tianhao
contents In this survey, we provide an overview of category theory-derived machine learning from four mainstream perspectives: gradient-based learning, probability-based learning, invariance and equivalence-based learning, and topos-based learning. For the first three topics, we primarily review research in the past five years, updating and expanding on the previous survey by Shiebler et al.. The fourth topic, which delves into higher category theory, particularly topos theory, is surveyed for the first time in this paper. In certain machine learning methods, the compositionality of functors plays a vital role, prompting the development of specific categorical frameworks. However, when considering how the global properties of a network reflect in local structures and how geometric properties are expressed with logic, the topos structure becomes particularly significant and profound.
format Preprint
id arxiv_https___arxiv_org_abs_2408_14014
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Category-Theoretical and Topos-Theoretical Frameworks in Machine Learning: A Survey
Jia, Yiyang
Peng, Guohong
Yang, Zheng
Chen, Tianhao
Machine Learning
In this survey, we provide an overview of category theory-derived machine learning from four mainstream perspectives: gradient-based learning, probability-based learning, invariance and equivalence-based learning, and topos-based learning. For the first three topics, we primarily review research in the past five years, updating and expanding on the previous survey by Shiebler et al.. The fourth topic, which delves into higher category theory, particularly topos theory, is surveyed for the first time in this paper. In certain machine learning methods, the compositionality of functors plays a vital role, prompting the development of specific categorical frameworks. However, when considering how the global properties of a network reflect in local structures and how geometric properties are expressed with logic, the topos structure becomes particularly significant and profound.
title Category-Theoretical and Topos-Theoretical Frameworks in Machine Learning: A Survey
topic Machine Learning
url https://arxiv.org/abs/2408.14014