Fast and Functional Structured Data Generators Rooted in Out-of-Equilibrium Physics
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2023
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866913679900934144 |
|---|---|
| author | Carbone, Alessandra Decelle, Aurélien Rosset, Lorenzo Seoane, Beatriz |
| author_facet | Carbone, Alessandra Decelle, Aurélien Rosset, Lorenzo Seoane, Beatriz |
| contents | In this study, we address the challenge of using energy-based models to produce high-quality, label-specific data in complex structured datasets, such as population genetics, RNA or protein sequences data. Traditional training methods encounter difficulties due to inefficient Markov chain Monte Carlo mixing, which affects the diversity of synthetic data and increases generation times. To address these issues, we use a novel training algorithm that exploits non-equilibrium effects. This approach, applied on the Restricted Boltzmann Machine, improves the model's ability to correctly classify samples and generate high-quality synthetic data in only a few sampling steps. The effectiveness of this method is demonstrated by its successful application to four different types of data: handwritten digits, mutations of human genomes classified by continental origin, functionally characterized sequences of an enzyme protein family, and homologous RNA sequences from specific taxonomies. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2307_06797 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Fast and Functional Structured Data Generators Rooted in Out-of-Equilibrium Physics Carbone, Alessandra Decelle, Aurélien Rosset, Lorenzo Seoane, Beatriz Machine Learning Disordered Systems and Neural Networks Biomolecules Genomics Quantitative Methods In this study, we address the challenge of using energy-based models to produce high-quality, label-specific data in complex structured datasets, such as population genetics, RNA or protein sequences data. Traditional training methods encounter difficulties due to inefficient Markov chain Monte Carlo mixing, which affects the diversity of synthetic data and increases generation times. To address these issues, we use a novel training algorithm that exploits non-equilibrium effects. This approach, applied on the Restricted Boltzmann Machine, improves the model's ability to correctly classify samples and generate high-quality synthetic data in only a few sampling steps. The effectiveness of this method is demonstrated by its successful application to four different types of data: handwritten digits, mutations of human genomes classified by continental origin, functionally characterized sequences of an enzyme protein family, and homologous RNA sequences from specific taxonomies. |
| title | Fast and Functional Structured Data Generators Rooted in Out-of-Equilibrium Physics |
| topic | Machine Learning Disordered Systems and Neural Networks Biomolecules Genomics Quantitative Methods |
| url | https://arxiv.org/abs/2307.06797 |