Saved in:
Bibliographic Details
Main Authors: Bennett, Max S., Zollo, Thomas P., Zemel, Richard
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2602.23201
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Modern machine learning models are deployed in diverse, non-stationary environments where they must continually adapt to new tasks and evolving knowledge. Continual fine-tuning and in-context learning are costly and brittle, whereas neural memory methods promise lightweight updates with minimal forgetting. However, existing neural memory models typically assume a single fixed objective and homogeneous information streams, leaving users with no control over what the model remembers or ignores over time. To address this challenge, we propose a generalized neural memory system that performs flexible updates based on learning instructions specified in natural language. Our approach enables adaptive agents to learn selectively from heterogeneous information sources, supporting settings, such as healthcare and customer service, where fixed-objective memory updates are insufficient.