Salvato in:
Dettagli Bibliografici
Autori principali: Li, Chunna, Song, Yiwei, Shao, Yuanhai
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:https://arxiv.org/abs/2509.15593
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914047015780352
author Li, Chunna
Song, Yiwei
Shao, Yuanhai
author_facet Li, Chunna
Song, Yiwei
Shao, Yuanhai
contents In transfer learning, a source domain often carries diverse knowledge, and different domains usually emphasize different types of knowledge. Different from handling only a single type of knowledge from all domains in traditional transfer learning methods, we introduce an ensemble learning framework with a weak mode of convergence in the form of Statistical Invariant (SI) for multi-source transfer learning, formulated as Stochastic Ensemble Multi-Source Transfer Learning Using Statistical Invariant (SETrLUSI). The proposed SI extracts and integrates various types of knowledge from both source and target domains, which not only effectively utilizes diverse knowledge but also accelerates the convergence process. Further, SETrLUSI incorporates stochastic SI selection, proportional source domain sampling, and target domain bootstrapping, which improves training efficiency while enhancing model stability. Experiments show that SETrLUSI has good convergence and outperforms related methods with a lower time cost.
format Preprint
id arxiv_https___arxiv_org_abs_2509_15593
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SETrLUSI: Stochastic Ensemble Multi-Source Transfer Learning Using Statistical Invariant
Li, Chunna
Song, Yiwei
Shao, Yuanhai
Machine Learning
In transfer learning, a source domain often carries diverse knowledge, and different domains usually emphasize different types of knowledge. Different from handling only a single type of knowledge from all domains in traditional transfer learning methods, we introduce an ensemble learning framework with a weak mode of convergence in the form of Statistical Invariant (SI) for multi-source transfer learning, formulated as Stochastic Ensemble Multi-Source Transfer Learning Using Statistical Invariant (SETrLUSI). The proposed SI extracts and integrates various types of knowledge from both source and target domains, which not only effectively utilizes diverse knowledge but also accelerates the convergence process. Further, SETrLUSI incorporates stochastic SI selection, proportional source domain sampling, and target domain bootstrapping, which improves training efficiency while enhancing model stability. Experiments show that SETrLUSI has good convergence and outperforms related methods with a lower time cost.
title SETrLUSI: Stochastic Ensemble Multi-Source Transfer Learning Using Statistical Invariant
topic Machine Learning
url https://arxiv.org/abs/2509.15593