Saved in:
Bibliographic Details
Main Authors: Kundu, Soumyabrata, Kondor, Risi
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.15932
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • We introduce Steerable Transformers, an extension of the Vision Transformer mechanism that maintains equivariance to the special Euclidean group $\mathrm{SE}(d)$. We propose an equivariant attention mechanism that operates on features extracted by steerable convolutions. Operating in Fourier space, our network utilizes Fourier space non-linearities. Our experiments in both two and three dimensions show that adding steerable transformer layers to steerable convolutional networks enhances performance.