Discrete approach to machine learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kashitsyn, Dmitriy, Shabanov, Dmitriy
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915422891147264
author Kashitsyn, Dmitriy
Shabanov, Dmitriy
author_facet Kashitsyn, Dmitriy
Shabanov, Dmitriy
contents The article explores an encoding and structural information processing approach using sparse bit vectors and fixed-length linear vectors. The following are presented: a discrete method of speculative stochastic dimensionality reduction of multidimensional code and linear spaces with linear asymptotic complexity; a geometric method for obtaining discrete embeddings of an organised code space that reflect the internal structure of a given modality. The structure and properties of a code space are investigated using three modalities as examples: morphology of Russian and English languages, and immunohistochemical markers. Parallels are drawn between the resulting map of the code space layout and so-called pinwheels appearing on the mammalian neocortex. A cautious assumption is made about similarities between neocortex organisation and processes happening in our models.
format Preprint
id arxiv_https___arxiv_org_abs_2508_00869
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Discrete approach to machine learning
Kashitsyn, Dmitriy
Shabanov, Dmitriy
Machine Learning
Emerging Technologies
Information Theory
The article explores an encoding and structural information processing approach using sparse bit vectors and fixed-length linear vectors. The following are presented: a discrete method of speculative stochastic dimensionality reduction of multidimensional code and linear spaces with linear asymptotic complexity; a geometric method for obtaining discrete embeddings of an organised code space that reflect the internal structure of a given modality. The structure and properties of a code space are investigated using three modalities as examples: morphology of Russian and English languages, and immunohistochemical markers. Parallels are drawn between the resulting map of the code space layout and so-called pinwheels appearing on the mammalian neocortex. A cautious assumption is made about similarities between neocortex organisation and processes happening in our models.
title Discrete approach to machine learning
topic Machine Learning
Emerging Technologies
Information Theory
url https://arxiv.org/abs/2508.00869