The Sparse Tsetlin Machine: Sparse Representation with Active Literals
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909199835856896 |
|---|---|
| author | Østby, Sebastian Brambo, Tobias M. Glimsdal, Sondre |
| author_facet | Østby, Sebastian Brambo, Tobias M. Glimsdal, Sondre |
| contents | This paper introduces the Sparse Tsetlin Machine (STM), a novel Tsetlin Machine (TM) that processes sparse data efficiently. Traditionally, the TM does not consider data characteristics such as sparsity, commonly seen in NLP applications and other bag-of-word-based representations. Consequently, a TM must initialize, store, and process a significant number of zero values, resulting in excessive memory usage and computational time. Previous attempts at creating a sparse TM have predominantly been unsuccessful, primarily due to their inability to identify which literals are sufficient for TM training. By introducing Active Literals (AL), the STM can focus exclusively on literals that actively contribute to the current data representation, significantly decreasing memory footprint and computational time while demonstrating competitive classification performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_02375 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | The Sparse Tsetlin Machine: Sparse Representation with Active Literals Østby, Sebastian Brambo, Tobias M. Glimsdal, Sondre Machine Learning Artificial Intelligence Formal Languages and Automata Theory This paper introduces the Sparse Tsetlin Machine (STM), a novel Tsetlin Machine (TM) that processes sparse data efficiently. Traditionally, the TM does not consider data characteristics such as sparsity, commonly seen in NLP applications and other bag-of-word-based representations. Consequently, a TM must initialize, store, and process a significant number of zero values, resulting in excessive memory usage and computational time. Previous attempts at creating a sparse TM have predominantly been unsuccessful, primarily due to their inability to identify which literals are sufficient for TM training. By introducing Active Literals (AL), the STM can focus exclusively on literals that actively contribute to the current data representation, significantly decreasing memory footprint and computational time while demonstrating competitive classification performance. |
| title | The Sparse Tsetlin Machine: Sparse Representation with Active Literals |
| topic | Machine Learning Artificial Intelligence Formal Languages and Automata Theory |
| url | https://arxiv.org/abs/2405.02375 |