Cover Image

Yet Unnoticed in LSTM: Binary Tree Based Input Reordering, Weight Regularization, and Gate Nonlinearization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Moattari, Mojtaba
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Study on Variants of Conventional, Fuzzy, and Nullspace-Based Independence Criteria for Improving Supervised and Unsupervised Learning
by: Moattari, Mojtaba
Published: (2025)

Precise classification of low quality G-banded Chromosome Images by reliability metrics and data pruning classifier
by: Moattari, Mojtaba
Published: (2025)

On Measuring Unnoticeability of Graph Adversarial Attacks: Observations, New Measure, and Applications
by: Jo, Hyeonsoo, et al.
Published: (2025)

Lightweight LSTM Model for Energy Theft Detection via Input Data Reduction
by: Collier, Caylum, et al.
Published: (2025)

Evaluating the Sensitivity of BiLSTM Forecasting Models to Sequence Length and Input Noise
by: Albelali, Salma, et al.
Published: (2025)

Has LLM Reached the Scaling Ceiling Yet? Unified Insights into LLM Regularities and Constraints
by: Luo, Charles
Published: (2024)

Rethinking Gating Mechanism in Sparse MoE: Handling Arbitrary Modality Inputs with Confidence-Guided Gate
by: Zheng, Liangwei Nathan, et al.
Published: (2025)

Factorization-in-Loop: Proximal Fill-in Minimization for Sparse Matrix Reordering
by: Li, Ziwei, et al.
Published: (2025)

DynamicGate MLP Conditional Computation via Learned Structural Dropout and Input Dependent Gating for Functional Plasticity
by: Choi, Yong Il
Published: (2026)

Activation-Descent Regularization for Input Optimization of ReLU Networks
by: Yu, Hongzhan, et al.
Published: (2024)

WAVE: Weighted Autoregressive Varying Gate for Time Series Forecasting
by: Lu, Jiecheng, et al.
Published: (2024)

WEST GCN-LSTM: Weighted Stacked Spatio-Temporal Graph Neural Networks for Regional Traffic Forecasting
by: Theodoropoulos, Theodoros, et al.
Published: (2024)

Geometric Regularization in Mixture-of-Experts: The Disconnect Between Weights and Activations
by: Kim, Hyunjun
Published: (2026)

ReCalKV: Low-Rank KV Cache Compression via Head Reordering and Offline Calibration
by: Yan, Xianglong, et al.
Published: (2025)

Robust Yet Efficient Conformal Prediction Sets
by: Zargarbashi, Soroush H., et al.
Published: (2024)

Weight Concentration Regularization for Improving Pruning Robustness Under High Sparsity
by: Yun, Vincent-Daniel, et al.
Published: (2025)

CLCR: Contrastive Learning-based Constraint Reordering for Efficient MILP Solving
by: Zeng, Shuli, et al.
Published: (2025)

Masked-and-Reordered Self-Supervision for Reinforcement Learning from Verifiable Rewards
by: Wang, Zhen, et al.
Published: (2025)

packetLSTM: Dynamic LSTM Framework for Streaming Data with Varying Feature Space
by: Agarwal, Rohit, et al.
Published: (2024)

Enhancing Spatiotemporal Networks with xLSTM: A Scalar LSTM Approach for Cellular Traffic Forecasting
by: Ali, Khalid, et al.
Published: (2025)

FLAIN: Mitigating Backdoor Attacks in Federated Learning via Flipping Weight Updates of Low-Activation Input Neurons
by: Ding, Binbin, et al.
Published: (2024)

MILP-SAT-GNN: Yet Another Neural SAT Solver
by: Cardillo, Franco Alberto, et al.
Published: (2025)

Beyond Weighted Summation: Learnable Nonlinear Aggregation Functions for Robust Artificial Neurons
by: Bozyigit, Berke Deniz
Published: (2026)

Network Level Spatial Temporal Traffic State Forecasting with Hierarchical-Attention-LSTM (HierAttnLSTM)
by: Zhang, Tianya
Published: (2022)

Gating is Weighting: Understanding Gated Linear Attention through In-context Learning
by: Li, Yingcong, et al.
Published: (2025)

Relevance-driven Input Dropout: an Explanation-guided Regularization Technique
by: Gururaj, Shreyas, et al.
Published: (2025)

Aging Decline in Basketball Career Trend Prediction Based on Machine Learning and LSTM Model
by: Yao, Yi-chen, et al.
Published: (2025)

Commercial LLM Agents Are Already Vulnerable to Simple Yet Dangerous Attacks
by: Li, Ang, et al.
Published: (2025)

Not Yet AlphaFold for the Mind: Evaluating Centaur as a Synthetic Participant
by: Namazova, Sabrina, et al.
Published: (2025)

BRAID: Input-Driven Nonlinear Dynamical Modeling of Neural-Behavioral Data
by: Vahidi, Parsa, et al.
Published: (2025)

Data Diversity as Implicit Regularization: How Does Diversity Shape the Weight Space of Deep Neural Networks?
by: Ba, Yang, et al.
Published: (2024)

Collaborative Yet Personalized Policy Training: Single-Timescale Federated Actor-Critic
by: Wang, Leo Muxing, et al.
Published: (2026)

Enhanced Photovoltaic Power Forecasting: An iTransformer and LSTM-Based Model Integrating Temporal and Covariate Interactions
by: Wu, Guang, et al.
Published: (2024)

SimDiff: Simpler Yet Better Diffusion Model for Time Series Point Forecasting
by: Ding, Hang, et al.
Published: (2025)

MolMix: A Simple Yet Effective Baseline for Multimodal Molecular Representation Learning
by: Manolache, Andrei, et al.
Published: (2024)

Dominant Shuffle: A Simple Yet Powerful Data Augmentation for Time-series Prediction
by: Zhao, Kai, et al.
Published: (2024)

Why LLMs Aren't Scientists Yet: Lessons from Four Autonomous Research Attempts
by: Trehan, Dhruv, et al.
Published: (2026)

An Uncertainty-Aware ED-LSTM for Probabilistic Suffix Prediction
by: Mustroph, Henryk, et al.
Published: (2025)

xLSTM: Extended Long Short-Term Memory
by: Beck, Maximilian, et al.
Published: (2024)

Deep Dictionary-Free Method for Identifying Linear Model of Nonlinear System with Input Delay
by: Valábek, Patrik, et al.
Published: (2025)