Copertina

HadamRNN: Binary and Sparse Ternary Orthogonal RNNs

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Foucault, Armand, Mamalet, Franck, Malgouyres, François
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Quantized Approximately Orthogonal Recurrent Neural Networks
di: Foucault, Armand, et al.
Pubblicazione: (2024)

FlashRNN: I/O-Aware Optimization of Traditional RNNs on modern hardware
di: Pöppel, Korbinian, et al.
Pubblicazione: (2024)

Straight-Through meets Sparse Recovery: the Support Exploration Algorithm
di: Mohamed, Mimoun, et al.
Pubblicazione: (2023)

M$^2$RNN: Non-Linear RNNs with Matrix-Valued States for Scalable Language Modeling
di: Mishra, Mayank, et al.
Pubblicazione: (2026)

Balancing Sparse RNNs with Hyperparameterization Benefiting Meta-Learning
di: Hershey, Quincy, et al.
Pubblicazione: (2025)

Geometry-induced Regularization in Deep ReLU Neural Networks
di: Bona-Pellissier, Joachim, et al.
Pubblicazione: (2024)

Efficient Robust Conformal Prediction via Lipschitz-Bounded Networks
di: Massena, Thomas, et al.
Pubblicazione: (2025)

Turbo-Muon: Accelerating Orthogonality-Based Optimization with Pre-Conditioning
di: Boissin, Thibaut, et al.
Pubblicazione: (2025)

Memory Caching: RNNs with Growing Memory
di: Behrouz, Ali, et al.
Pubblicazione: (2026)

Were RNNs All We Needed?
di: Feng, Leo, et al.
Pubblicazione: (2024)

$\texttt{lrnnx}$: A library for Linear RNNs
di: Bania, Karan, et al.
Pubblicazione: (2026)

Pessimistic Iterative Planning with RNNs for Robust POMDPs
di: Galesloot, Maris F. L., et al.
Pubblicazione: (2024)

Implicit Language Models are RNNs: Balancing Parallelization and Expressivity
di: Schöne, Mark, et al.
Pubblicazione: (2025)

Evaluating and Designing Sparse Autoencoders by Approximating Quasi-Orthogonality
di: Lee, Sewoong, et al.
Pubblicazione: (2025)

On the explainable properties of 1-Lipschitz Neural Networks: An Optimal Transport Perspective
di: Serrurier, Mathieu, et al.
Pubblicazione: (2022)

Orthogonium : A Unified, Efficient Library of Orthogonal and 1-Lipschitz Building Blocks
di: Boissin, Thibaut, et al.
Pubblicazione: (2026)

Stabilizing RNN Gradients through Pre-training
di: Herranz-Celotti, Luca, et al.
Pubblicazione: (2023)

Does Transformer Interpretability Transfer to RNNs?
di: Paulo, Gonçalo, et al.
Pubblicazione: (2024)

Paradoxical noise preference in RNNs
di: Eckstein, Noah, et al.
Pubblicazione: (2026)

Learning Dynamics of RNNs in Closed-Loop Environments
di: Ger, Yoav, et al.
Pubblicazione: (2025)

Compositional Reasoning with Transformers, RNNs, and Chain of Thought
di: Yehudai, Gilad, et al.
Pubblicazione: (2025)

Sparser, Better, Deeper, Stronger: Improving Sparse Training with Exact Orthogonal Initialization
di: Nowak, Aleksandra Irena, et al.
Pubblicazione: (2024)

Renaissance of RNNs in Streaming Clinical Time Series: Compact Recurrence Remains Competitive with Transformers
di: Tong, Ran, et al.
Pubblicazione: (2025)

Detecting Invariant Manifolds in ReLU-Based RNNs
di: Eisenmann, Lukas, et al.
Pubblicazione: (2025)

Learning reveals invisible structure in low-rank RNNs
di: Ger, Yoav, et al.
Pubblicazione: (2026)

SKOLR: Structured Koopman Operator Linear RNN for Time-Series Forecasting
di: Zhang, Yitian, et al.
Pubblicazione: (2025)

PIAD-SRNN: Physics-Informed Adaptive Decomposition in State-Space RNN
di: Mohammadshirazi, Ahmad, et al.
Pubblicazione: (2024)

TempoPFN: Synthetic Pre-training of Linear RNNs for Zero-shot Time Series Forecasting
di: Moroshan, Vladyslav, et al.
Pubblicazione: (2025)

Wireless Federated Multi-Task LLM Fine-Tuning via Sparse-and-Orthogonal LoRA
di: Yang, Nuocheng, et al.
Pubblicazione: (2026)

Forecasting Cryptocurrency Prices using Contextual ES-adRNN with Exogenous Variables
di: Smyl, Slawek, et al.
Pubblicazione: (2025)

Public Transit Arrival Prediction: a Seq2Seq RNN Approach
di: Bhutani, Nancy, et al.
Pubblicazione: (2022)

What is the best RNN-cell structure to forecast each time series behavior?
di: Khaldi, Rohaifa, et al.
Pubblicazione: (2022)

Learning to (Learn at Test Time): RNNs with Expressive Hidden States
di: Sun, Yu, et al.
Pubblicazione: (2024)

Tiled Flash Linear Attention: More Efficient Linear RNN and xLSTM Kernels
di: Beck, Maximilian, et al.
Pubblicazione: (2025)

ISMRNN: An Implicitly Segmented RNN Method with Mamba for Long-Term Time Series Forecasting
di: Zhao, GaoXiang, et al.
Pubblicazione: (2024)

SLaB: Sparse-Lowrank-Binary Decomposition for Efficient Large Language Models
di: Li, Ziwei, et al.
Pubblicazione: (2026)

Decentralized Structural-RNN for Robot Crowd Navigation with Deep Reinforcement Learning
di: Liu, Shuijing, et al.
Pubblicazione: (2020)

Asymmetrical Latent Representation for Individual Treatment Effect Modeling
di: Lacombe, Armand, et al.
Pubblicazione: (2025)

Path Channels and Plan Extension Kernels: a Mechanistic Description of Planning in a Sokoban RNN
di: Taufeeque, Mohammad, et al.
Pubblicazione: (2025)

A Comprehensive Overview and Comparative Analysis on Deep Learning Models: CNN, RNN, LSTM, GRU
di: Shiri, Farhad Mortezapour, et al.
Pubblicazione: (2023)