Copertina

B'MOJO: Hybrid State Space Realizations of Foundation Models with Eidetic and Fading Memory

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zancato, Luca, Seshadri, Arjun, Dukler, Yonatan, Golatkar, Aditya, Shen, Yantao, Bowman, Benjamin, Trager, Matthew, Achille, Alessandro, Soatto, Stefano
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Computation and Language Neural and Evolutionary Computing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Expansion Span: Combining Fading Memory and Retrieval in Hybrid State Space Models
di: Nunez, Elvis, et al.
Pubblicazione: (2024)

PICASO: Permutation-Invariant Context Composition with State Space Models
di: Liu, Tian Yu, et al.
Pubblicazione: (2025)

Hidden Traveling Waves bind Working Memory Variables in Recurrent Neural Networks
di: Karuvally, Arjun, et al.
Pubblicazione: (2024)

Exponential Dynamic Energy Network for High Capacity Sequence Memory
di: Karuvally, Arjun, et al.
Pubblicazione: (2025)

Fast Exploration of the Impact of Precision Reduction on Spiking Neural Networks
di: Saeedi, Sepide, et al.
Pubblicazione: (2022)

Kernel Memory Networks: A Unifying Framework for Memory Modeling
di: Iatropoulos, Georgios, et al.
Pubblicazione: (2022)

Transient Dynamics in Lattices of Differentiating Ring Oscillators
di: DelMastro, Peter, et al.
Pubblicazione: (2025)

Dense Associative Memories with Analog Circuits
di: Bacvanski, Marc Gong, et al.
Pubblicazione: (2025)

Sustainable AI: Mathematical Foundations of Spiking Neural Networks
di: Fono, Adalbert, et al.
Pubblicazione: (2025)

Optimal Memory Encoding Through Fluctuation-Response Structure
di: Cui, Lianxiang, et al.
Pubblicazione: (2026)

Bridging Expressivity and Scalability with Adaptive Unitary SSMs
di: Karuvally, Arjun, et al.
Pubblicazione: (2025)

Evolving Symbiosis, from Barricelli's Legacy to Collective Intelligence: a simulated and conceptual approach
di: Ashford, James, et al.
Pubblicazione: (2026)

A Neuromorphic Model of Learning Meaningful Sequences with Long-Term Memory
di: Iyer, Laxmi R., et al.
Pubblicazione: (2025)

Multi-threaded Memory Efficient Crossover in C++ for Generational Genetic Programming
di: Langdon, W. B.
Pubblicazione: (2020)

Continuous signal sparse encoding using analog neuromorphic variability
di: Costa, Filippo, et al.
Pubblicazione: (2025)

Evolutionary Reinforcement Learning for Interpretable Decision-Making in Supply Chain Management
di: Genetti, Stefano, et al.
Pubblicazione: (2025)

Oscillator-Based Associative Memory with Exponential Capacity: Theory, Algorithms, and Hardware Implementation
di: Ogranovich, Arie, et al.
Pubblicazione: (2026)

Memory Enhanced Fractional-Order Dung Beetle Optimization for Photovoltaic Parameter Identification
di: Li, Yiwei, et al.
Pubblicazione: (2025)

Associative Memory Model with Neural Networks: Memorizing multiple images with one neuron
di: Inazawa, Hiroshi
Pubblicazione: (2025)

A new simplified MOPSO based on Swarm Elitism and Swarm Memory: MO-ETPSO
di: Fitas, Ricardo
Pubblicazione: (2024)

Neuromorphic Circuits with Spiking Astrocytes for Increased Energy Efficiency, Fault Tolerance, and Memory Capacitance
di: Yunusoglu, Aybars, et al.
Pubblicazione: (2025)

A Compute and Communication Runtime Model for Loihi 2
di: Timcheck, Jonathan, et al.
Pubblicazione: (2026)

EngramNCA: a Neural Cellular Automaton Model of Memory Transfer
di: Guichard, Etienne, et al.
Pubblicazione: (2025)

Deep Reinforcement Learning-Assisted Component Auto-Configuration of Differential Evolution Algorithm for Constrained Optimization: A Foundation Model
di: Yang, Xu, et al.
Pubblicazione: (2025)

High-Performance Temporal Reversible Spiking Neural Networks with $O(L)$ Training Memory and $O(1)$ Inference Cost
di: Hu, JiaKui, et al.
Pubblicazione: (2024)

The More the Merrier: On Evolving Five-valued Spectra Boolean Functions
di: Carlet, Claude, et al.
Pubblicazione: (2024)

Energy efficiency analysis of Spiking Neural Networks for space applications
di: Lunghi, Paolo, et al.
Pubblicazione: (2025)

Spiker-LL: An Energy-Efficient FPGA Accelerator Enabling Adaptive Local Learning in Spiking Neural Networks
di: Caviglia, Alessio, et al.
Pubblicazione: (2026)

SpikeExplorer: hardware-oriented Design Space Exploration for Spiking Neural Networks on FPGA
di: Padovano, Dario, et al.
Pubblicazione: (2024)

Energy-Efficient Digital Design: A Comparative Study of Event-Driven and Clock-Driven Spiking Neurons
di: Marostica, Filippo, et al.
Pubblicazione: (2025)

Evolutionary Mapping of Neural Networks to Spatial Accelerators
di: Pierro, Alessandro, et al.
Pubblicazione: (2026)

Descriminative-Generative Custom Tokens for Vision-Language Models
di: Perera, Pramuditha, et al.
Pubblicazione: (2025)

NeuroTrain: Surveying Local Learning Rules for Spiking Neural Networks with an Open Benchmarking Framework
di: Caviglia, Alessio, et al.
Pubblicazione: (2026)

CPR: Retrieval Augmented Generation for Copyright Protection
di: Golatkar, Aditya, et al.
Pubblicazione: (2024)

Neural Associative Skill Memories for safer robotics and modelling human sensorimotor repertoires
di: Mahajan, Pranav, et al.
Pubblicazione: (2025)

Learning Random Numbers to Realize Appendable Memory System for Artificial Intelligence to Acquire New Knowledge after Deployment
di: Yamada, Kazunori D
Pubblicazione: (2024)

Parallel Delayed Memory Units for Enhanced Temporal Modeling in Biomedical and Bioacoustic Signal Analysis
di: Sun, Pengfei, et al.
Pubblicazione: (2025)

Hybrid Synaptic Structure for Spiking Neural Network Realization
di: Razmkhah, Sasan, et al.
Pubblicazione: (2023)

Why Evolve When You Can Adapt? Post-Evolution Adaptation of Genetic Memory for On-the-Fly Control
di: Hammami, Hamze, et al.
Pubblicazione: (2025)

Memory Wall is not gone: A Critical Outlook on Memory Architecture in Digital Neuromorphic Computing
di: Yousefzadeh, Amirreza, et al.
Pubblicazione: (2026)