Classification by Separating Hypersurfaces: An Entropic Approach
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913924489674752 |
|---|---|
| author | Arratia, Argimiro Daou, Mahmoud El Gzyl, Henryk |
| author_facet | Arratia, Argimiro Daou, Mahmoud El Gzyl, Henryk |
| contents | We consider the following classification problem: Given a population of individuals characterized by a set of attributes represented as a vector in ${\mathbb R}^N$, the goal is to find a hyperplane in ${\mathbb R}^N$ that separates two sets of points corresponding to two distinct classes. This problem, with a history dating back to the perceptron model, remains central to machine learning. In this paper we propose a novel approach by searching for a vector of parameters in a bounded $N$-dimensional hypercube centered at the origin and a positive vector in ${\mathbb R}^M$, obtained through the minimization of an entropy-based function defined over the space of unknown variables. The method extends to polynomial surfaces, allowing the separation of data points by more complex decision boundaries. This provides a robust alternative to traditional linear or quadratic optimization techniques, such as support vector machines and gradient descent. Numerical experiments demonstrate the efficiency and versatility of the method in handling diverse classification tasks, including linear and non-linear separability. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_02732 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Classification by Separating Hypersurfaces: An Entropic Approach Arratia, Argimiro Daou, Mahmoud El Gzyl, Henryk Machine Learning Information Theory Data Analysis, Statistics and Probability 90C05, 90C25, 90C47, 90C52, 68T01, 68T05, 68T07, 68T20, 68W01 We consider the following classification problem: Given a population of individuals characterized by a set of attributes represented as a vector in ${\mathbb R}^N$, the goal is to find a hyperplane in ${\mathbb R}^N$ that separates two sets of points corresponding to two distinct classes. This problem, with a history dating back to the perceptron model, remains central to machine learning. In this paper we propose a novel approach by searching for a vector of parameters in a bounded $N$-dimensional hypercube centered at the origin and a positive vector in ${\mathbb R}^M$, obtained through the minimization of an entropy-based function defined over the space of unknown variables. The method extends to polynomial surfaces, allowing the separation of data points by more complex decision boundaries. This provides a robust alternative to traditional linear or quadratic optimization techniques, such as support vector machines and gradient descent. Numerical experiments demonstrate the efficiency and versatility of the method in handling diverse classification tasks, including linear and non-linear separability. |
| title | Classification by Separating Hypersurfaces: An Entropic Approach |
| topic | Machine Learning Information Theory Data Analysis, Statistics and Probability 90C05, 90C25, 90C47, 90C52, 68T01, 68T05, 68T07, 68T20, 68W01 |
| url | https://arxiv.org/abs/2507.02732 |