SymmetryLens: Unsupervised Symmetry Learning via Locality and Density Preservation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Efe, Onur, Ozakin, Arkadas
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912463696429056
author Efe, Onur
Ozakin, Arkadas
author_facet Efe, Onur
Ozakin, Arkadas
contents We develop a new unsupervised symmetry learning method that starts with raw data and provides the minimal generator of an underlying Lie group of symmetries, together with a symmetry-equivariant representation of the data, which turns the hidden symmetry into an explicit one. The method is able to learn the pixel translation operator from a dataset with only an approximate translation symmetry and can learn quite different types of symmetries that are not apparent to the naked eye. The method is based on the formulation of an information-theoretic loss function that measures both the degree of symmetry of a dataset under a candidate symmetry generator and a proposed notion of locality of the samples, which is coupled to symmetry. We demonstrate that this coupling between symmetry and locality, together with an optimization technique developed for entropy estimation, results in a stable system that provides reproducible results.
format Preprint
id arxiv_https___arxiv_org_abs_2410_05232
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle SymmetryLens: Unsupervised Symmetry Learning via Locality and Density Preservation
Efe, Onur
Ozakin, Arkadas
Machine Learning
We develop a new unsupervised symmetry learning method that starts with raw data and provides the minimal generator of an underlying Lie group of symmetries, together with a symmetry-equivariant representation of the data, which turns the hidden symmetry into an explicit one. The method is able to learn the pixel translation operator from a dataset with only an approximate translation symmetry and can learn quite different types of symmetries that are not apparent to the naked eye. The method is based on the formulation of an information-theoretic loss function that measures both the degree of symmetry of a dataset under a candidate symmetry generator and a proposed notion of locality of the samples, which is coupled to symmetry. We demonstrate that this coupling between symmetry and locality, together with an optimization technique developed for entropy estimation, results in a stable system that provides reproducible results.
title SymmetryLens: Unsupervised Symmetry Learning via Locality and Density Preservation
topic Machine Learning
url https://arxiv.org/abs/2410.05232