Aggregation Models with Optimal Weights for Distributed Gaussian Processes

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Chen, Haoyuan, Tuo, Rui
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911435753259008
author Chen, Haoyuan
Tuo, Rui
author_facet Chen, Haoyuan
Tuo, Rui
contents Gaussian process (GP) models have received increasing attention in recent years due to their superb prediction accuracy and modeling flexibility. To address the computational burdens of GP models for large-scale datasets, distributed learning for GPs are often adopted. Current aggregation models for distributed GPs is not time-efficient when incorporating correlations between GP experts. In this work, we propose a novel approach for aggregated prediction in distributed GPs. The technique is suitable for both the exact and sparse variational GPs. The proposed method incorporates correlations among experts, leading to better prediction accuracy with manageable computational requirements. As demonstrated by empirical studies, the proposed approach results in more stable predictions in less time than state-of-the-art consistent aggregation models.
format Preprint
id arxiv_https___arxiv_org_abs_2408_00955
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Aggregation Models with Optimal Weights for Distributed Gaussian Processes
Chen, Haoyuan
Tuo, Rui
Machine Learning
Methodology
Gaussian process (GP) models have received increasing attention in recent years due to their superb prediction accuracy and modeling flexibility. To address the computational burdens of GP models for large-scale datasets, distributed learning for GPs are often adopted. Current aggregation models for distributed GPs is not time-efficient when incorporating correlations between GP experts. In this work, we propose a novel approach for aggregated prediction in distributed GPs. The technique is suitable for both the exact and sparse variational GPs. The proposed method incorporates correlations among experts, leading to better prediction accuracy with manageable computational requirements. As demonstrated by empirical studies, the proposed approach results in more stable predictions in less time than state-of-the-art consistent aggregation models.
title Aggregation Models with Optimal Weights for Distributed Gaussian Processes
topic Machine Learning
Methodology
url https://arxiv.org/abs/2408.00955