Algebraic Machine Learning: Learning as computing an algebraic decomposition of a task
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909514730569728 |
|---|---|
| author | Martin-Maroto, Fernando Abderrahaman, Nabil Mendez, David de Polavieja, Gonzalo G. |
| author_facet | Martin-Maroto, Fernando Abderrahaman, Nabil Mendez, David de Polavieja, Gonzalo G. |
| contents | Statistics and Optimization are foundational to modern Machine Learning. Here, we propose an alternative foundation based on Abstract Algebra, with mathematics that facilitates the analysis of learning. In this approach, the goal of the task and the data are encoded as axioms of an algebra, and a model is obtained where only these axioms and their logical consequences hold. Although this is not a generalizing model, we show that selecting specific subsets of its breakdown into algebraic atoms obtained via subdirect decomposition gives a model that generalizes. We validate this new learning principle on standard datasets such as MNIST, FashionMNIST, CIFAR-10, and medical images, achieving performance comparable to optimized multilayer perceptrons. Beyond data-driven tasks, the new learning principle extends to formal problems, such as finding Hamiltonian cycles from their specifications and without relying on search. This algebraic foundation offers a fresh perspective on machine intelligence, featuring direct learning from training data without the need for validation dataset, scaling through model additivity, and asymptotic convergence to the underlying rule in the data. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_19944 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Algebraic Machine Learning: Learning as computing an algebraic decomposition of a task Martin-Maroto, Fernando Abderrahaman, Nabil Mendez, David de Polavieja, Gonzalo G. Machine Learning Artificial Intelligence Discrete Mathematics Symbolic Computation Combinatorics 03G10, 06A12, 06A06, 08A70, 68R01, 68T01 G.2.3; I.1.2; I.2.6; I.2.8 Statistics and Optimization are foundational to modern Machine Learning. Here, we propose an alternative foundation based on Abstract Algebra, with mathematics that facilitates the analysis of learning. In this approach, the goal of the task and the data are encoded as axioms of an algebra, and a model is obtained where only these axioms and their logical consequences hold. Although this is not a generalizing model, we show that selecting specific subsets of its breakdown into algebraic atoms obtained via subdirect decomposition gives a model that generalizes. We validate this new learning principle on standard datasets such as MNIST, FashionMNIST, CIFAR-10, and medical images, achieving performance comparable to optimized multilayer perceptrons. Beyond data-driven tasks, the new learning principle extends to formal problems, such as finding Hamiltonian cycles from their specifications and without relying on search. This algebraic foundation offers a fresh perspective on machine intelligence, featuring direct learning from training data without the need for validation dataset, scaling through model additivity, and asymptotic convergence to the underlying rule in the data. |
| title | Algebraic Machine Learning: Learning as computing an algebraic decomposition of a task |
| topic | Machine Learning Artificial Intelligence Discrete Mathematics Symbolic Computation Combinatorics 03G10, 06A12, 06A06, 08A70, 68R01, 68T01 G.2.3; I.1.2; I.2.6; I.2.8 |
| url | https://arxiv.org/abs/2502.19944 |