Cover Image

E2Former: An Efficient and Equivariant Transformer with Linear-Scaling Tensor Products

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Yunyang, Huang, Lin, Ding, Zhihao, Wang, Chu, Wei, Xinran, Yang, Han, Wang, Zun, Liu, Chang, Shi, Yu, Jin, Peiran, Qin, Tao, Gerstein, Mark, Zhang, Jia
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Materials Science
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

E2Former-V2: On-the-Fly Equivariant Attention with Linear Activation Memory
by: Huang, Lin, et al.
Published: (2026)

Elign: Equivariant Diffusion Model Alignment from Foundational Machine Learning Force Fields
by: Li, Yunyang, et al.
Published: (2026)

Enhancing the Scalability and Applicability of Kohn-Sham Hamiltonians for Molecular Systems
by: Li, Yunyang, et al.
Published: (2025)

Efficient and Scalable Density Functional Theory Hamiltonian Prediction through Adaptive Sparsity
by: Luo, Erpai, et al.
Published: (2025)

Long-Short-Range Message-Passing: A Physics-Informed Framework to Capture Non-Local Interaction for Scalable Molecular Dynamics Simulation
by: Li, Yunyang, et al.
Published: (2023)

Efficient Privacy-Preserving Training of Quantum Neural Networks by Using Mixed States to Represent Input Data Ensembles
by: Wang, Gaoyuan, et al.
Published: (2025)

RingFormer: A Ring-Enhanced Graph Transformer for Organic Solar Cell Property Prediction
by: Ding, Zhihao, et al.
Published: (2024)

Towards Unified AI Models for MU-MIMO Communications: A Tensor Equivariance Framework
by: Wang, Yafei, et al.
Published: (2024)

Efficient Equivariant High-Order Crystal Tensor Prediction via Cartesian Local-Environment Many-Body Coupling
by: Jin, Dian, et al.
Published: (2026)

ScatterFormer: Efficient Voxel Transformer with Scattered Linear Attention
by: He, Chenhang, et al.
Published: (2024)

Unlocking Symbol-Level Precoding Efficiency Through Tensor Equivariant Neural Network
by: Zhang, Jinshuo, et al.
Published: (2025)

A Multimodal Fusion Network For Student Emotion Recognition Based on Transformer and Tensor Product
by: Xiang, Ao, et al.
Published: (2024)

AlgoFormer: An Efficient Transformer Framework with Algorithmic Structures
by: Gao, Yihang, et al.
Published: (2024)

MemoryFormer: Minimize Transformer Computation by Removing Fully-Connected Layers
by: Ding, Ning, et al.
Published: (2024)

Enabling Efficient Equivariant Operations in the Fourier Basis via Gaunt Tensor Products
by: Luo, Shengjie, et al.
Published: (2024)

Equivariant Interatomic Potentials without Tensor Products
by: Reschützegger, Thiago, et al.
Published: (2026)

E(n)-Equivariant Cartesian Tensor Passing Potential
by: Wang, Junjie, et al.
Published: (2024)

A Survey of Generative AI for de novo Drug Design: New Frontiers in Molecule and Protein Generation
by: Tang, Xiangru, et al.
Published: (2024)

JobFormer: Skill-Aware Job Recommendation with Semantic-Enhanced Transformer
by: Guan, Zhihao, et al.
Published: (2024)

TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters
by: Wang, Haiyang, et al.
Published: (2024)

HiMemFormer: Hierarchical Memory-Aware Transformer for Multi-Agent Action Anticipation
by: Wang, Zirui, et al.
Published: (2024)

Magnitude-Modulated Equivariant Adapter for Parameter-Efficient Fine-Tuning of Equivariant Graph Neural Networks
by: Jin, Dian, et al.
Published: (2025)

VecFormer: Towards Efficient and Generalizable Graph Transformer with Graph Token Attention
by: Zhou, Jingbo, et al.
Published: (2026)

LIT-Former: Linking In-plane and Through-plane Transformers for Simultaneous CT Image Denoising and Deblurring
by: Chen, Zhihao, et al.
Published: (2023)

LinFormer: A Linear-based Lightweight Transformer Architecture For Time-Aware MIMO Channel Prediction
by: Jin, Yanliang, et al.
Published: (2024)

DiffsFormer: A Diffusion Transformer on Stock Factor Augmentation
by: Gao, Yuan, et al.
Published: (2024)

CipherFormer: Efficient Transformer Private Inference with Low Round Complexity
by: Wang, Weize, et al.
Published: (2024)

MixFormerV2: Efficient Fully Transformer Tracking
by: Cui, Yutao, et al.
Published: (2023)

Equivariant Spherical Transformer for Efficient Molecular Modeling
by: An, Junyi, et al.
Published: (2025)

Scalable Machine Learning Force Fields for Macromolecular Systems Through Long-Range Aware Message Passing
by: Wang, Chu, et al.
Published: (2026)

MonoFormer: One Transformer for Both Diffusion and Autoregression
by: Zhao, Chuyang, et al.
Published: (2024)

AnchorFormer: Differentiable Anchor Attention for Efficient Vision Transformer
by: Shan, Jiquan, et al.
Published: (2025)

MG-Former: A Transformer-Based Framework for Music-Driven 3D Conducting Gesture Generation
by: Qiu, Ke, et al.
Published: (2026)

Local-Canonicalization Equivariant Graph Neural Networks for Sample-Efficient and Generalizable Swarm Robot Control
by: Wang, Keqin, et al.
Published: (2025)

EncFormer: Secure and Efficient Transformer Inference over Encrypted Data
by: Zhu, Yufan, et al.
Published: (2026)

$ζ$-QVAE: A Quantum Variational Autoencoder utilizing Regularized Mixed-state Latent Representations
by: Wang, Gaoyuan, et al.
Published: (2024)

TinyFormer: Efficient Transformer Design and Deployment on Tiny Devices
by: Yang, Jianlei, et al.
Published: (2023)

KnapFormer: An Online Load Balancer for Efficient Diffusion Transformers Training
by: Zhang, Kai, et al.
Published: (2025)

PolaFormer: Polarity-aware Linear Attention for Vision Transformers
by: Meng, Weikang, et al.
Published: (2025)

The Price of Freedom: Exploring Expressivity and Runtime Tradeoffs in Equivariant Tensor Products
by: Xie, YuQing, et al.
Published: (2025)