Wasserstein Transfer Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Kaicheng, Zhang, Sinian, Zhou, Doudou, Zhou, Yidong
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909864398159872
author Zhang, Kaicheng
Zhang, Sinian
Zhou, Doudou
Zhou, Yidong
author_facet Zhang, Kaicheng
Zhang, Sinian
Zhou, Doudou
Zhou, Yidong
contents Transfer learning is a powerful paradigm for leveraging knowledge from source domains to enhance learning in a target domain. However, traditional transfer learning approaches often focus on scalar or multivariate data within Euclidean spaces, limiting their applicability to complex data structures such as probability distributions. To address this limitation, we introduce a novel transfer learning framework for regression models whose outputs are probability distributions residing in the Wasserstein space. When the informative subset of transferable source domains is known, we propose an estimator with provable asymptotic convergence rates, quantifying the impact of domain similarity on transfer efficiency. For cases where the informative subset is unknown, we develop a data-driven transfer learning procedure designed to mitigate negative transfer. The proposed methods are supported by rigorous theoretical analysis and are validated through extensive simulations and real-world applications. The code is available at https://github.com/h7nian/WaTL
format Preprint
id arxiv_https___arxiv_org_abs_2505_17404
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Wasserstein Transfer Learning
Zhang, Kaicheng
Zhang, Sinian
Zhou, Doudou
Zhou, Yidong
Machine Learning
Statistics Theory
Transfer learning is a powerful paradigm for leveraging knowledge from source domains to enhance learning in a target domain. However, traditional transfer learning approaches often focus on scalar or multivariate data within Euclidean spaces, limiting their applicability to complex data structures such as probability distributions. To address this limitation, we introduce a novel transfer learning framework for regression models whose outputs are probability distributions residing in the Wasserstein space. When the informative subset of transferable source domains is known, we propose an estimator with provable asymptotic convergence rates, quantifying the impact of domain similarity on transfer efficiency. For cases where the informative subset is unknown, we develop a data-driven transfer learning procedure designed to mitigate negative transfer. The proposed methods are supported by rigorous theoretical analysis and are validated through extensive simulations and real-world applications. The code is available at https://github.com/h7nian/WaTL
title Wasserstein Transfer Learning
topic Machine Learning
Statistics Theory
url https://arxiv.org/abs/2505.17404