Enabling Robust In-Context Memory and Rapid Task Adaptation in Transformers with Hebbian and Gradient-Based Plasticity

Documenti analoghi

• SNAP: Stopping Catastrophic Forgetting in Hebbian Learning with Sigmoidal Neuronal Adaptive Plasticity
  di: Xu, Tianyi, et al.
  Pubblicazione: (2024)
• Learning Successor Features with Distributed Hebbian Temporal Memory
  di: Dzhivelikian, Evgenii, et al.
  Pubblicazione: (2023)
• Neuron-centric Hebbian Learning
  di: Ferigo, Andrea, et al.
  Pubblicazione: (2024)
• A Truly Sparse and General Implementation of Gradient-Based Synaptic Plasticity
  di: Lohoff, Jamie, et al.
  Pubblicazione: (2025)
• Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
  di: Munkhdalai, Tsendsuren, et al.
  Pubblicazione: (2024)