Cover Image

State-space models can learn in-context by gradient descent

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sushma, Neeraj Mohan, Tian, Yudou, Mestha, Harshvardhan, Colombo, Nicolo, Kappel, David, Subramoney, Anand
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence Neural and Evolutionary Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Scalable Event-by-event Processing of Neuromorphic Sensory Signals With Deep State-Space Models
by: Schöne, Mark, et al.
Published: (2024)

Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models
by: Mukherji, Rishav, et al.
Published: (2024)

STREAM: A Universal State-Space Model for Sparse Geometric Data
by: Schöne, Mark, et al.
Published: (2024)

Fractional-order spike-timing-dependent gradient descent for multi-layer spiking neural networks
by: Yang, Yi, et al.
Published: (2024)

Asynchronous Stochastic Gradient Descent with Decoupled Backpropagation and Layer-Wise Updates
by: Fokam, Cabrel Teguemne, et al.
Published: (2024)

Implementing engrams from a machine learning perspective: the relevance of a latent space
by: de Lucas, J Marco
Published: (2024)

Similarity-based context aware continual learning for spiking neural networks
by: Han, Bing, et al.
Published: (2024)

Towards Robust and Accurate Myoelectric Controller Design based on Multi-objective Optimization using Evolutionary Computation
by: Shaikh, Ahmed Aqeel, et al.
Published: (2022)

One system for learning and remembering episodes and rules
by: Hewson, Joshua T. S., et al.
Published: (2024)

Quality-Diversity Meta-Evolution: customising behaviour spaces to a meta-objective
by: Bossens, David M., et al.
Published: (2021)

An exploration for higher efficiency in multi objective optimisation with reinforcement learning
by: Aydin, Mehmet Emin
Published: (2025)

Surrogate-Assisted Genetic Programming with Rank-Based Phenotypic Characterisation for Dynamic Multi-Mode Project Scheduling
by: Tian, Yuan, et al.
Published: (2026)

Reinforcement learning Based Automated Design of Differential Evolution Algorithm for Black-box Optimization
by: Yang, Xu, et al.
Published: (2025)

Thalamus: a brain-inspired algorithm for biologically-plausible continual learning and disentangled representations
by: Hummos, Ali
Published: (2022)

Deep Reinforcement Learning with Spiking Q-learning
by: Chen, Ding, et al.
Published: (2022)

Supervised learning of spatial features with STDP and homeostasis using Spiking Neural Networks on SpiNNaker
by: Davies, Sergio, et al.
Published: (2023)

Evolution Transformer: In-Context Evolutionary Optimization
by: Lange, Robert Tjarko, et al.
Published: (2024)

GeM-EA: A Generative and Meta-learning Enhanced Evolutionary Algorithm for Streaming Data-Driven Optimization
by: Wu, Yue, et al.
Published: (2026)

Optimal Synthesis of Finite State Machines with Universal Gates using Evolutionary Algorithm
by: Ullah, Noor, et al.
Published: (2024)

To Repair or Not to Repair? Investigating the Importance of AB-Cycles for the State-of-the-Art TSP Heuristic EAX
by: Heins, Jonathan, et al.
Published: (2025)

Dancing to the State of the Art? How Candidate Lists Influence LKH for Solving the Traveling Salesperson Problem
by: Heins, Jonathan, et al.
Published: (2024)

SPikE-SSM: A Sparse, Precise, and Efficient Spiking State Space Model for Long Sequences Learning
by: Zhong, Yan, et al.
Published: (2024)

Evolutionary thoughts: integration of large language models and evolutionary algorithms
by: Yepes, Antonio Jimeno, et al.
Published: (2025)

Multi-Bit Mechanism: A Novel Information Transmission Paradigm for Spiking Neural Networks
by: Xiao, Yongjun, et al.
Published: (2024)

A High-Throughput Spiking Neural Network Processor Enabling Synaptic Delay Emulation
by: Chen, Faquan, et al.
Published: (2025)

Differential learning kinetics govern the transition from memorization to generalization during in-context learning
by: Nguyen, Alex, et al.
Published: (2024)

Comparative study of regression vs pairwise models for surrogate-based heuristic optimisation
by: Naharro, Pablo S., et al.
Published: (2024)

Learning with Spike Synchrony in Spiking Neural Networks
by: Tian, Yuchen, et al.
Published: (2025)

Discrete Differential Evolution Particle Swarm Optimization Algorithm for Energy Saving Flexible Job Shop Scheduling Problem Considering Machine Multi States
by: Wang, Da, et al.
Published: (2025)

Language Modeling on a SpiNNaker 2 Neuromorphic Chip
by: Nazeer, Khaleelulla Khan, et al.
Published: (2023)

Evolutionary fine tuning of quantized convolution-based deep learning models
by: Pietroń, Marcin
Published: (2026)

Large Language Models as In-context AI Generators for Quality-Diversity
by: Lim, Bryan, et al.
Published: (2024)

Understanding Transformer-based Vision Models through Inversion
by: Rathjens, Jan, et al.
Published: (2024)

Spikingformer: A Key Foundation Model for Spiking Neural Networks
by: Zhou, Chenlin, et al.
Published: (2023)

REMS: a unified solution representation, problem modeling and metaheuristic algorithm design for general combinatorial optimization problems
by: Song, Aijuan, et al.
Published: (2025)

An LLM-Empowered Adaptive Evolutionary Algorithm For Multi-Component Deep Learning Systems
by: Tian, Haoxiang, et al.
Published: (2025)

Task-Specific Activation Functions for Neuroevolution using Grammatical Evolution
by: Winter, Benjamin David, et al.
Published: (2025)

Evaluating a Novel Neuroevolution and Neural Architecture Search System
by: Winter, Benjamin David, et al.
Published: (2025)

Ecological Neural Architecture Search
by: Winter, Benjamin David, et al.
Published: (2025)

Painful intelligence: What AI can tell us about human suffering
by: Hyvärinen, Aapo
Published: (2022)