Copertina

The Inhibitor: ReLU and Addition-Based Attention for Efficient Transformers under Fully Homomorphic Encryption on the Torus

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Brännvall, Rickard, Stoian, Andrei
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Machine Learning 68T07 68T07 I.2.6
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Inhibitor Transformers and Gated RNNs for Torus Efficient Fully Homomorphic Encryption
di: Brännvall, Rickard, et al.
Pubblicazione: (2023)

InhibiDistilbert: Knowledge Distillation for a ReLU and Addition-based Transformer
di: Zhang, Tony, et al.
Pubblicazione: (2025)

Is ReLU Adversarially Robust?
di: Sooksatra, Korn, et al.
Pubblicazione: (2024)

From Features to Graphs: Exploring Graph Structures and Pairwise Interactions via GNNs
di: Yamchote, Phaphontee, et al.
Pubblicazione: (2025)

Distinguished In Uniform: Self Attention Vs. Virtual Nodes
di: Rosenbluth, Eran, et al.
Pubblicazione: (2024)

When Does Content-Based Routing Work? Representation Requirements for Selective Attention in Hybrid Sequence Models
di: Basu, Abhinaba
Pubblicazione: (2026)

FeNeC: Enhancing Continual Learning via Feature Clustering with Neighbor- or Logit-Based Classification
di: Książek, Kamil, et al.
Pubblicazione: (2025)

Correction and Corruption: A Two-Rate View of Error Flow in LLM Protocols
di: Reitich, Fernando
Pubblicazione: (2026)

Just In Time Transformers
di: Benali, Ahmed Ala Eddine, et al.
Pubblicazione: (2024)

Deep Hedging Under Non-Convexity: Limitations and a Case for AlphaZero
di: Maggiolo, Matteo, et al.
Pubblicazione: (2025)

Stage-wise Dynamics of Classifier-Free Guidance in Diffusion Models
di: Jin, Cheng, et al.
Pubblicazione: (2025)

Drift-Resilient TabPFN: In-Context Learning Temporal Distribution Shifts on Tabular Data
di: Helli, Kai, et al.
Pubblicazione: (2024)

X-Factor: Quality Is a Dataset-Intrinsic Property
di: Couch, Josiah, et al.
Pubblicazione: (2025)

A Constraint-Preserving Neural Network Approach for Solving Mean-Field Games Equilibrium
di: Liu, Jinwei, et al.
Pubblicazione: (2025)

The Domain Mixed Unit: A New Neural Arithmetic Layer
di: Curry, Paul
Pubblicazione: (2025)

Deep learning four decades of human migration
di: Gaskin, Thomas, et al.
Pubblicazione: (2025)

IntSeqBERT: Learning Arithmetic Structure in OEIS via Modulo-Spectrum Embeddings
di: Nakasho, Kazuhisa
Pubblicazione: (2026)

Your contrastive learning problem is secretly a distribution alignment problem
di: Chen, Zihao, et al.
Pubblicazione: (2025)

Developing Explainable Machine Learning Model using Augmented Concept Activation Vector
di: Hassanpour, Reza, et al.
Pubblicazione: (2024)

Client-Conditional Federated Learning via Local Training Data Statistics
di: Brännvall, Rickard
Pubblicazione: (2026)

Optimizing Inference in Transformer-Based Models: A Multi-Method Benchmark
di: Ho, Siu Hang, et al.
Pubblicazione: (2025)

Advances in Set Function Learning: A Survey of Techniques and Applications
di: Xie, Jiahao, et al.
Pubblicazione: (2025)

Backpropagation Through Time For Networks With Long-Term Dependencies
di: Bird, George, et al.
Pubblicazione: (2021)

Explicit Dropout: Deterministic Regularization for Transformer Architectures
di: Agrawal, Vidhi, et al.
Pubblicazione: (2026)

Step-Aware Residual-Guided Diffusion for EEG Spatial Super-Resolution
di: Liu, Hongjun, et al.
Pubblicazione: (2025)

ProactBench: Beyond What The User Asked For
di: Harfi, Sepehr, et al.
Pubblicazione: (2026)

Gradient descent provably escapes saddle points in the training of shallow ReLU networks
di: Cheridito, Patrick, et al.
Pubblicazione: (2022)

An Improved Adaptive PID Optimizer with Enhanced Convergence and Stability for Deep Learning
di: Saini, Saurabh, et al.
Pubblicazione: (2026)

MAcPNN: Mutual Assisted Learning on Data Streams with Temporal Dependence
di: Giannini, Federico, et al.
Pubblicazione: (2026)

Territory Paint Wars: Diagnosing and Mitigating Failure Modes in Competitive Multi-Agent PPO
di: Singh, Diyansha
Pubblicazione: (2026)

Enhancing Predictive Accuracy in Tennis: Integrating Fuzzy Logic and CV-GRNN for Dynamic Match Outcome and Player Momentum Analysis
di: Li, Kechen, et al.
Pubblicazione: (2025)

Graph Transformers: A Survey
di: Shehzad, Ahsan, et al.
Pubblicazione: (2024)

Neural Concept Verifier: Scaling Prover-Verifier Games via Concept Encodings
di: Turan, Berkant, et al.
Pubblicazione: (2025)

Lost in Aggregation: On a Fundamental Expressivity Limit of Message-Passing Graph Neural Networks
di: Rosenbluth, Eran
Pubblicazione: (2026)

Repetition Makes Perfect: Recurrent Graph Neural Networks Match Message-Passing Limit
di: Rosenbluth, Eran, et al.
Pubblicazione: (2025)

CGLearn: Consistent Gradient-Based Learning for Out-of-Distribution Generalization
di: Chowdhury, Jawad, et al.
Pubblicazione: (2024)

An Artificial Intelligence-Based Framework for Predicting Emergency Department Overcrowding: Development and Evaluation Study
di: Vural, Orhun, et al.
Pubblicazione: (2025)

The Concept Allocation Zone: Tracking How Concepts Form Across Transformer Depth
di: Henry, James
Pubblicazione: (2026)

A Comparison Between Decision Transformers and Traditional Offline Reinforcement Learning Algorithms
di: Caunhye, Ali Murtaza, et al.
Pubblicazione: (2025)

Latent Object Permanence: Topological Phase Transitions, Free-Energy Principles, and Renormalization Group Flows in Deep Transformer Manifolds
di: Alpay, Faruk, et al.
Pubblicazione: (2026)