Imagen de Portada

Positional Encoding Helps Recurrent Neural Networks Handle a Large Vocabulary

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Morita, Takashi
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Neural and Evolutionary Computing
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Extensional Properties of Recurrent Neural Networks
por: Dantsin, Evgeny, et al.
Publicado: (2024)

Emergence of the Primacy Effect in Structured State-Space Models
por: Morita, Takashi
Publicado: (2025)

Multi-Objective Evolutionary Neural Architecture Search for Recurrent Neural Networks
por: Booysen, Reinhard, et al.
Publicado: (2024)

Optimizing Neural Network Performance and Interpretability with Diophantine Equation Encoding
por: Katende, Ronald
Publicado: (2024)

Curriculum Design Helps Spiking Neural Networks to Classify Time Series
por: Sun, Chenxi, et al.
Publicado: (2023)

Gated Recurrent Neural Networks with Weighted Time-Delay Feedback
por: Erichson, N. Benjamin, et al.
Publicado: (2022)

Accelerating Linear Recurrent Neural Networks for the Edge with Unstructured Sparsity
por: Pierro, Alessandro, et al.
Publicado: (2025)

SQUAT: Stateful Quantization-Aware Training in Recurrent Spiking Neural Networks
por: Venkatesh, Sreyes, et al.
Publicado: (2024)

Rethinking Recurrent Neural Networks for Time Series Forecasting: A Reinforced Recurrent Encoder with Prediction-Oriented Proximal Policy Optimization
por: Lai, Xin, et al.
Publicado: (2026)

GridPE: Unifying Positional Encoding in Transformers with a Grid Cell-Inspired Framework
por: Li, Boyang, et al.
Publicado: (2024)

Sleep-Based Homeostatic Regularization for Stabilizing Spike-Timing-Dependent Plasticity in Recurrent Spiking Neural Networks
por: Massey, Andreas, et al.
Publicado: (2026)

Set-based Neural Network Encoding Without Weight Tying
por: Andreis, Bruno, et al.
Publicado: (2023)

R-FORCE: Robust Learning for Random Recurrent Neural Networks
por: Zheng, Yang, et al.
Publicado: (2020)

Recurrent Joint Embedding Predictive Architecture with Recurrent Forward Propagation Learning
por: Velarde, Osvaldo M, et al.
Publicado: (2024)

Oscillations enhance time-series prediction in reservoir computing with feedback
por: Kawai, Yuji, et al.
Publicado: (2024)

Scalable Learning in Structured Recurrent Spiking Neural Networks without Backpropagation
por: Tang, Bo, et al.
Publicado: (2026)

A Scalable Hybrid Training Approach for Recurrent Spiking Neural Networks
por: Baronig, Maximilian, et al.
Publicado: (2025)

Cyclic Neural Network
por: Yang, Liangwei, et al.
Publicado: (2024)

Airborne Neural Network
por: Ranjan, Paritosh, et al.
Publicado: (2025)

Spiking Neural Networks with Random Network Architecture
por: Dai, Zihan, et al.
Publicado: (2025)

An Autoencoder and Generative Adversarial Networks Approach for Multi-Omics Data Imbalanced Class Handling and Classification
por: Al-Hurani, Ibrahim, et al.
Publicado: (2024)

Understanding Vector-Valued Neural Networks and Their Relationship with Real and Hypercomplex-Valued Neural Networks
por: Valle, Marcos Eduardo
Publicado: (2023)

Input Invex Neural Network
por: Sapkota, Suman, et al.
Publicado: (2021)

Physics-Modeled Neural Networks
por: Felipe-Sosa, Raul, et al.
Publicado: (2026)

Pruning Increases Orderedness in Recurrent Computation
por: Song, Yiding
Publicado: (2025)

SNNAX -- Spiking Neural Networks in JAX
por: Lohoff, Jamie, et al.
Publicado: (2024)

Self-Supervised Neural Architecture Search for Multimodal Deep Neural Networks
por: Suzuki, Shota, et al.
Publicado: (2025)

ChronoPlastic Spiking Neural Networks
por: Chaudhry, Sarim
Publicado: (2025)

Deep Pulse-Coupled Neural Networks
por: Yi, Zexiang, et al.
Publicado: (2023)

Multi Part Deployment of Neural Network
por: Ranjan, Paritosh, et al.
Publicado: (2025)

Recurrent Distance Filtering for Graph Representation Learning
por: Ding, Yuhui, et al.
Publicado: (2023)

Recurrent Neural Networks Learn to Store and Generate Sequences using Non-Linear Representations
por: Csordás, Róbert, et al.
Publicado: (2024)

Exploiting Chaotic Dynamics as Deep Neural Networks
por: Liu, Shuhong, et al.
Publicado: (2024)

E(n) Equivariant Topological Neural Networks
por: Battiloro, Claudio, et al.
Publicado: (2024)

The Role of Temporal Hierarchy in Spiking Neural Networks
por: Moro, Filippo, et al.
Publicado: (2024)

Topology-Aware Activation Functions in Neural Networks
por: Snopov, Pavel, et al.
Publicado: (2025)

Probabilistically Rewired Message-Passing Neural Networks
por: Qian, Chendi, et al.
Publicado: (2023)

Learning Long Sequences in Spiking Neural Networks
por: Stan, Matei Ioan, et al.
Publicado: (2023)

On Space Folds of ReLU Neural Networks
por: Lewandowski, Michal, et al.
Publicado: (2025)

The Evolution of Learning Algorithms for Artificial Neural Networks
por: Baxter, Jonathan
Publicado: (2025)