Lite-RVFL: A Lightweight Random Vector Functional-Link Neural Network for Learning Under Concept Drift

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hu, Songqiao, Liu, Zeyi, He, Xiao
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916786958499840
author Hu, Songqiao
Liu, Zeyi
He, Xiao
author_facet Hu, Songqiao
Liu, Zeyi
He, Xiao
contents The change in data distribution over time, also known as concept drift, poses a significant challenge to the reliability of online learning methods. Existing methods typically require model retraining or drift detection, both of which demand high computational costs and are often unsuitable for real-time applications. To address these limitations, a lightweight, fast and efficient random vector functional-link network termed Lite-RVFL is proposed, capable of adapting to concept drift without drift detection and retraining. Lite-RVFL introduces a novel objective function that assigns weights exponentially increasing to new samples, thereby emphasizing recent data and enabling timely adaptation. Theoretical analysis confirms the feasibility of this objective function for drift adaptation, and an efficient incremental update rule is derived. Experimental results on a real-world safety assessment task validate the efficiency, effectiveness in adapting to drift, and potential to capture temporal patterns of Lite-RVFL. The source code is available at https://github.com/songqiaohu/Lite-RVFL.
format Preprint
id arxiv_https___arxiv_org_abs_2506_08063
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Lite-RVFL: A Lightweight Random Vector Functional-Link Neural Network for Learning Under Concept Drift
Hu, Songqiao
Liu, Zeyi
He, Xiao
Machine Learning
Systems and Control
The change in data distribution over time, also known as concept drift, poses a significant challenge to the reliability of online learning methods. Existing methods typically require model retraining or drift detection, both of which demand high computational costs and are often unsuitable for real-time applications. To address these limitations, a lightweight, fast and efficient random vector functional-link network termed Lite-RVFL is proposed, capable of adapting to concept drift without drift detection and retraining. Lite-RVFL introduces a novel objective function that assigns weights exponentially increasing to new samples, thereby emphasizing recent data and enabling timely adaptation. Theoretical analysis confirms the feasibility of this objective function for drift adaptation, and an efficient incremental update rule is derived. Experimental results on a real-world safety assessment task validate the efficiency, effectiveness in adapting to drift, and potential to capture temporal patterns of Lite-RVFL. The source code is available at https://github.com/songqiaohu/Lite-RVFL.
title Lite-RVFL: A Lightweight Random Vector Functional-Link Neural Network for Learning Under Concept Drift
topic Machine Learning
Systems and Control
url https://arxiv.org/abs/2506.08063