Symmetry-Aware Generative Modeling through Learned Canonicalization
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910121398894592 |
|---|---|
| author | Sareen, Kusha Levy, Daniel Mondal, Arnab Kumar Kaba, Sékou-Oumar Akhound-Sadegh, Tara Ravanbakhsh, Siamak |
| author_facet | Sareen, Kusha Levy, Daniel Mondal, Arnab Kumar Kaba, Sékou-Oumar Akhound-Sadegh, Tara Ravanbakhsh, Siamak |
| contents | Generative modeling of symmetric densities has a range of applications in AI for science, from drug discovery to physics simulations. The existing generative modeling paradigm for invariant densities combines an invariant prior with an equivariant generative process. However, we observe that this technique is not necessary and has several drawbacks resulting from the limitations of equivariant networks. Instead, we propose to model a learned slice of the density so that only one representative element per orbit is learned. To accomplish this, we learn a group-equivariant canonicalization network that maps training samples to a canonical pose and train a non-equivariant generative model over these canonicalized samples. We implement this idea in the context of diffusion models. Our preliminary experimental results on molecular modeling are promising, demonstrating improved sample quality and faster inference time. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_07773 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Symmetry-Aware Generative Modeling through Learned Canonicalization Sareen, Kusha Levy, Daniel Mondal, Arnab Kumar Kaba, Sékou-Oumar Akhound-Sadegh, Tara Ravanbakhsh, Siamak Machine Learning Generative modeling of symmetric densities has a range of applications in AI for science, from drug discovery to physics simulations. The existing generative modeling paradigm for invariant densities combines an invariant prior with an equivariant generative process. However, we observe that this technique is not necessary and has several drawbacks resulting from the limitations of equivariant networks. Instead, we propose to model a learned slice of the density so that only one representative element per orbit is learned. To accomplish this, we learn a group-equivariant canonicalization network that maps training samples to a canonical pose and train a non-equivariant generative model over these canonicalized samples. We implement this idea in the context of diffusion models. Our preliminary experimental results on molecular modeling are promising, demonstrating improved sample quality and faster inference time. |
| title | Symmetry-Aware Generative Modeling through Learned Canonicalization |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2501.07773 |