Multi-View Incremental Learning with Structured Hebbian Plasticity for Enhanced Fusion Efficiency

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Chen, Yuhong, Song, Ailin, Yin, Huifeng, Zhong, Shuai, Chen, Fuhai, Xu, Qi, Wang, Shiping, Xu, Mingkun
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909431522918400
author Chen, Yuhong
Song, Ailin
Yin, Huifeng
Zhong, Shuai
Chen, Fuhai
Xu, Qi
Wang, Shiping
Xu, Mingkun
author_facet Chen, Yuhong
Song, Ailin
Yin, Huifeng
Zhong, Shuai
Chen, Fuhai
Xu, Qi
Wang, Shiping
Xu, Mingkun
contents The rapid evolution of multimedia technology has revolutionized human perception, paving the way for multi-view learning. However, traditional multi-view learning approaches are tailored for scenarios with fixed data views, falling short of emulating the intricate cognitive procedures of the human brain processing signals sequentially. Our cerebral architecture seamlessly integrates sequential data through intricate feed-forward and feedback mechanisms. In stark contrast, traditional methods struggle to generalize effectively when confronted with data spanning diverse domains, highlighting the need for innovative strategies that can mimic the brain's adaptability and dynamic integration capabilities. In this paper, we propose a bio-neurologically inspired multi-view incremental framework named MVIL aimed at emulating the brain's fine-grained fusion of sequentially arriving views. MVIL lies two fundamental modules: structured Hebbian plasticity and synaptic partition learning. The structured Hebbian plasticity reshapes the structure of weights to express the high correlation between view representations, facilitating a fine-grained fusion of view representations. Moreover, synaptic partition learning is efficient in alleviating drastic changes in weights and also retaining old knowledge by inhibiting partial synapses. These modules bionically play a central role in reinforcing crucial associations between newly acquired information and existing knowledge repositories, thereby enhancing the network's capacity for generalization. Experimental results on six benchmark datasets show MVIL's effectiveness over state-of-the-art methods.
format Preprint
id arxiv_https___arxiv_org_abs_2412_12801
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Multi-View Incremental Learning with Structured Hebbian Plasticity for Enhanced Fusion Efficiency
Chen, Yuhong
Song, Ailin
Yin, Huifeng
Zhong, Shuai
Chen, Fuhai
Xu, Qi
Wang, Shiping
Xu, Mingkun
Computer Vision and Pattern Recognition
Machine Learning
The rapid evolution of multimedia technology has revolutionized human perception, paving the way for multi-view learning. However, traditional multi-view learning approaches are tailored for scenarios with fixed data views, falling short of emulating the intricate cognitive procedures of the human brain processing signals sequentially. Our cerebral architecture seamlessly integrates sequential data through intricate feed-forward and feedback mechanisms. In stark contrast, traditional methods struggle to generalize effectively when confronted with data spanning diverse domains, highlighting the need for innovative strategies that can mimic the brain's adaptability and dynamic integration capabilities. In this paper, we propose a bio-neurologically inspired multi-view incremental framework named MVIL aimed at emulating the brain's fine-grained fusion of sequentially arriving views. MVIL lies two fundamental modules: structured Hebbian plasticity and synaptic partition learning. The structured Hebbian plasticity reshapes the structure of weights to express the high correlation between view representations, facilitating a fine-grained fusion of view representations. Moreover, synaptic partition learning is efficient in alleviating drastic changes in weights and also retaining old knowledge by inhibiting partial synapses. These modules bionically play a central role in reinforcing crucial associations between newly acquired information and existing knowledge repositories, thereby enhancing the network's capacity for generalization. Experimental results on six benchmark datasets show MVIL's effectiveness over state-of-the-art methods.
title Multi-View Incremental Learning with Structured Hebbian Plasticity for Enhanced Fusion Efficiency
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2412.12801