Structural features of the fly olfactory circuit mitigate the stability-plasticity dilemma in continual learning
Fuente:
arXiv
Guardado en:
| Autores principales: | , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866915134962663424 |
|---|---|
| author | Zou, Heming Zang, Yunliang Ji, Xiangyang |
| author_facet | Zou, Heming Zang, Yunliang Ji, Xiangyang |
| contents | Artificial neural networks face the stability-plasticity dilemma in continual learning, while the brain can maintain memories and remain adaptable. However, the biological strategies for continual learning and their potential to inspire learning algorithms in neural networks are poorly understood. This study presents a minimal model of the fly olfactory circuit to investigate the biological strategies that support continual odor learning. We introduce the fly olfactory circuit as a plug-and-play component, termed the Fly Model, which can integrate with modern machine learning methods to address this dilemma. Our findings demonstrate that the Fly Model enhances both memory stability and learning plasticity, overcoming the limitations of current continual learning strategies. We validated its effectiveness across various challenging continual learning scenarios using commonly used datasets. The fly olfactory system serves as an elegant biological circuit for lifelong learning, offering a module that enhances continual learning with minimal additional computational cost for machine learning. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_01427 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Structural features of the fly olfactory circuit mitigate the stability-plasticity dilemma in continual learning Zou, Heming Zang, Yunliang Ji, Xiangyang Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition Neurons and Cognition Artificial neural networks face the stability-plasticity dilemma in continual learning, while the brain can maintain memories and remain adaptable. However, the biological strategies for continual learning and their potential to inspire learning algorithms in neural networks are poorly understood. This study presents a minimal model of the fly olfactory circuit to investigate the biological strategies that support continual odor learning. We introduce the fly olfactory circuit as a plug-and-play component, termed the Fly Model, which can integrate with modern machine learning methods to address this dilemma. Our findings demonstrate that the Fly Model enhances both memory stability and learning plasticity, overcoming the limitations of current continual learning strategies. We validated its effectiveness across various challenging continual learning scenarios using commonly used datasets. The fly olfactory system serves as an elegant biological circuit for lifelong learning, offering a module that enhances continual learning with minimal additional computational cost for machine learning. |
| title | Structural features of the fly olfactory circuit mitigate the stability-plasticity dilemma in continual learning |
| topic | Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition Neurons and Cognition |
| url | https://arxiv.org/abs/2502.01427 |