RMAAT: Astrocyte-Inspired Memory Compression and Replay for Efficient Long-Context Transformers
Fuente:
arXiv
Saved in:
| Main Authors: | Mia, Md Zesun Ahmed, Bal, Malyaban, Sengupta, Abhronil |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Delving Deeper Into Astromorphic Transformers
by: Mia, Md Zesun Ahmed, et al.
Published: (2023)
by: Mia, Md Zesun Ahmed, et al.
Published: (2023)
Neuromorphic Cybersecurity with Semi-supervised Lifelong Learning
by: Mia, Md Zesun Ahmed, et al.
Published: (2025)
by: Mia, Md Zesun Ahmed, et al.
Published: (2025)
Trilinear Compute-in-Memory Architecture for Energy-Efficient Transformer Acceleration
by: Mia, Md Zesun Ahmed, et al.
Published: (2026)
by: Mia, Md Zesun Ahmed, et al.
Published: (2026)
Spatio-Temporal Pruning for Compressed Spiking Large Language Models
by: Jiang, Yi, et al.
Published: (2025)
by: Jiang, Yi, et al.
Published: (2025)
GRASP: GRouped Activation Shared Parameterization for Parameter-Efficient Fine-Tuning and Robust Inference of Transformers
by: Bal, Malyaban, et al.
Published: (2025)
by: Bal, Malyaban, et al.
Published: (2025)
Compressed Latent Replays for Lightweight Continual Learning on Spiking Neural Networks
by: Dequino, Alberto, et al.
Published: (2024)
by: Dequino, Alberto, et al.
Published: (2024)
P-SpikeSSM: Harnessing Probabilistic Spiking State Space Models for Long-Range Dependency Tasks
by: Bal, Malyaban, et al.
Published: (2024)
by: Bal, Malyaban, et al.
Published: (2024)
SpikingBERT: Distilling BERT to Train Spiking Language Models Using Implicit Differentiation
by: Bal, Malyaban, et al.
Published: (2023)
by: Bal, Malyaban, et al.
Published: (2023)
Benchmarking Spiking Neural Network Learning Methods with Varying Locality
by: Lin, Jiaqi, et al.
Published: (2024)
by: Lin, Jiaqi, et al.
Published: (2024)
EON-1: A Brain-Inspired Processor for Near-Sensor Extreme Edge Online Feature Extraction
by: Dobrita, Alexandra, et al.
Published: (2024)
by: Dobrita, Alexandra, et al.
Published: (2024)
Analog Alchemy: Neural Computation with In-Memory Inference, Learning and Routing
by: Demirag, Yigit
Published: (2024)
by: Demirag, Yigit
Published: (2024)
Scaling SNNs Trained Using Equilibrium Propagation to Convolutional Architectures
by: Lin, Jiaqi, et al.
Published: (2024)
by: Lin, Jiaqi, et al.
Published: (2024)
Exploring Extreme Quantization in Spiking Language Models
by: Bal, Malyaban, et al.
Published: (2024)
by: Bal, Malyaban, et al.
Published: (2024)
Quantum Long Short-term Memory with Differentiable Architecture Search
by: Chen, Samuel Yen-Chi, et al.
Published: (2025)
by: Chen, Samuel Yen-Chi, et al.
Published: (2025)
Scalable Equilibrium Propagation via Intermediate Error Signals for Deep Convolutional CRNNs
by: Lin, Jiaqi, et al.
Published: (2025)
by: Lin, Jiaqi, et al.
Published: (2025)
NeuSpin: Design of a Reliable Edge Neuromorphic System Based on Spintronics for Green AI
by: Ahmed, Soyed Tuhin, et al.
Published: (2024)
by: Ahmed, Soyed Tuhin, et al.
Published: (2024)
A Diagonal Structured State Space Model on Loihi 2 for Efficient Streaming Sequence Processing
by: Meyer, Svea Marie, et al.
Published: (2024)
by: Meyer, Svea Marie, et al.
Published: (2024)
Towards Efficient Formal Verification of Spiking Neural Network
by: Seong, Baekryun, et al.
Published: (2024)
by: Seong, Baekryun, et al.
Published: (2024)
CIMNAS: A Joint Framework for Compute-In-Memory-Aware Neural Architecture Search
by: Krestinskaya, Olga, et al.
Published: (2025)
by: Krestinskaya, Olga, et al.
Published: (2025)
Analog In-Memory Computing Attention Mechanism for Fast and Energy-Efficient Large Language Models
by: Leroux, Nathan, et al.
Published: (2024)
by: Leroux, Nathan, et al.
Published: (2024)
Design and development of opto-neural processors for simulation of neural networks trained in image detection for potential implementation in hybrid robotics
by: Shetty, Sanjana
Published: (2024)
by: Shetty, Sanjana
Published: (2024)
Gradient-based Design of Computational Granular Crystals
by: Parsa, Atoosa, et al.
Published: (2024)
by: Parsa, Atoosa, et al.
Published: (2024)
Noise-Aware Training of Neuromorphic Dynamic Device Networks
by: Manneschi, Luca, et al.
Published: (2024)
by: Manneschi, Luca, et al.
Published: (2024)
Improved Data Encoding for Emerging Computing Paradigms: From Stochastic to Hyperdimensional Computing
by: Moghadam, Mehran Shoushtari, et al.
Published: (2025)
by: Moghadam, Mehran Shoushtari, et al.
Published: (2025)
A Quantum-Inspired Algorithm for Solving Sudoku Puzzles and the MaxCut Problem
by: Zhao, Max B., et al.
Published: (2025)
by: Zhao, Max B., et al.
Published: (2025)
On when is Reservoir Computing with Cellular Automata Beneficial?
by: Glover, Tom, et al.
Published: (2024)
by: Glover, Tom, et al.
Published: (2024)
What is Cognitive Computing? An Architecture and State of The Art
by: Elnagar, Samaa, et al.
Published: (2023)
by: Elnagar, Samaa, et al.
Published: (2023)
cuAPO: A CUDA-based Parallelization of Artificial Protozoa Optimizer
by: Soliya, Henish, et al.
Published: (2025)
by: Soliya, Henish, et al.
Published: (2025)
Mem-elements based Neuromorphic Hardware for Neural Network Application
by: Singh, Ankur
Published: (2024)
by: Singh, Ankur
Published: (2024)
Topology Optimization of Random Memristors for Input-Aware Dynamic SNN
by: Wang, Bo, et al.
Published: (2024)
by: Wang, Bo, et al.
Published: (2024)
Hardware-aware training of models with synaptic delays for digital event-driven neuromorphic processors
by: Patino-Saucedo, Alberto, et al.
Published: (2024)
by: Patino-Saucedo, Alberto, et al.
Published: (2024)
Efficient Optimisation of Physical Reservoir Computers using only a Delayed Input
by: Picco, Enrico, et al.
Published: (2024)
by: Picco, Enrico, et al.
Published: (2024)
Stability and Geometry of Attractors in Neural Cellular Automata
by: Kvalsund, Mia-Katrin, et al.
Published: (2026)
by: Kvalsund, Mia-Katrin, et al.
Published: (2026)
Attention via Synaptic Plasticity is All You Need: A Biologically Inspired Spiking Neuromorphic Transformer
by: Mondal, Kallol, et al.
Published: (2025)
by: Mondal, Kallol, et al.
Published: (2025)
Resistive Memory-based Neural Differential Equation Solver for Score-based Diffusion Model
by: Yang, Jichang, et al.
Published: (2024)
by: Yang, Jichang, et al.
Published: (2024)
DendroNN: Dendrocentric Neural Networks for Energy-Efficient Classification of Event-Based Data
by: Krausse, Jann, et al.
Published: (2026)
by: Krausse, Jann, et al.
Published: (2026)
InDRiVE: Intrinsic Disagreement based Reinforcement for Vehicle Exploration through Curiosity Driven Generalized World Model
by: Khanzada, Feeza Khan, et al.
Published: (2025)
by: Khanzada, Feeza Khan, et al.
Published: (2025)
Joint Hardware-Workload Co-Optimization for In-Memory Computing Accelerators
by: Krestinskaya, Olga, et al.
Published: (2026)
by: Krestinskaya, Olga, et al.
Published: (2026)
Visualising the Attractor Landscape of Neural Cellular Automata
by: Stovold, James, et al.
Published: (2026)
by: Stovold, James, et al.
Published: (2026)
Spike-based Neuromorphic Computing for Next-Generation Computer Vision
by: Hasan, Md Sakib, et al.
Published: (2023)
by: Hasan, Md Sakib, et al.
Published: (2023)
Similar Items
-
Delving Deeper Into Astromorphic Transformers
by: Mia, Md Zesun Ahmed, et al.
Published: (2023) -
Neuromorphic Cybersecurity with Semi-supervised Lifelong Learning
by: Mia, Md Zesun Ahmed, et al.
Published: (2025) -
Trilinear Compute-in-Memory Architecture for Energy-Efficient Transformer Acceleration
by: Mia, Md Zesun Ahmed, et al.
Published: (2026) -
Spatio-Temporal Pruning for Compressed Spiking Large Language Models
by: Jiang, Yi, et al.
Published: (2025) -
GRASP: GRouped Activation Shared Parameterization for Parameter-Efficient Fine-Tuning and Robust Inference of Transformers
by: Bal, Malyaban, et al.
Published: (2025)