Invariant multiscale neural networks for data-scarce scientific applications
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913388371640320 |
|---|---|
| author | Schurov, I. Alforov, D. Katsnelson, M. Bagrov, A. Itin, A. |
| author_facet | Schurov, I. Alforov, D. Katsnelson, M. Bagrov, A. Itin, A. |
| contents | Success of machine learning (ML) in the modern world is largely determined by abundance of data. However at many industrial and scientific problems, amount of data is limited. Application of ML methods to data-scarce scientific problems can be made more effective via several routes, one of them is equivariant neural networks possessing knowledge of symmetries. Here we suggest that combination of symmetry-aware invariant architectures and stacks of dilated convolutions is a very effective and easy to implement receipt allowing sizable improvements in accuracy over standard approaches. We apply it to representative physical problems from different realms: prediction of bandgaps of photonic crystals, and network approximations of magnetic ground states. The suggested invariant multiscale architectures increase expressibility of networks, which allow them to perform better in all considered cases. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_08318 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Invariant multiscale neural networks for data-scarce scientific applications Schurov, I. Alforov, D. Katsnelson, M. Bagrov, A. Itin, A. Disordered Systems and Neural Networks Materials Science Machine Learning Optics Success of machine learning (ML) in the modern world is largely determined by abundance of data. However at many industrial and scientific problems, amount of data is limited. Application of ML methods to data-scarce scientific problems can be made more effective via several routes, one of them is equivariant neural networks possessing knowledge of symmetries. Here we suggest that combination of symmetry-aware invariant architectures and stacks of dilated convolutions is a very effective and easy to implement receipt allowing sizable improvements in accuracy over standard approaches. We apply it to representative physical problems from different realms: prediction of bandgaps of photonic crystals, and network approximations of magnetic ground states. The suggested invariant multiscale architectures increase expressibility of networks, which allow them to perform better in all considered cases. |
| title | Invariant multiscale neural networks for data-scarce scientific applications |
| topic | Disordered Systems and Neural Networks Materials Science Machine Learning Optics |
| url | https://arxiv.org/abs/2406.08318 |