Empirical Bayes Estimation with Side Information: A Nonparametric Integrative Tweedie Approach

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Luo, Jiajun, Banerjee, Trambak, Mukherjee, Gourab, Sun, Wenguang
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917921601617920
author Luo, Jiajun
Banerjee, Trambak
Mukherjee, Gourab
Sun, Wenguang
author_facet Luo, Jiajun
Banerjee, Trambak
Mukherjee, Gourab
Sun, Wenguang
contents We investigate the problem of compound estimation of normal means while accounting for the presence of side information. Leveraging the empirical Bayes framework, we develop a nonparametric integrative Tweedie (NIT) approach that incorporates structural knowledge encoded in multivariate auxiliary data to enhance the precision of compound estimation. Our approach employs convex optimization tools to estimate the gradient of the log-density directly, enabling the incorporation of structural constraints. We conduct theoretical analyses of the asymptotic risk of NIT and establish the rate at which NIT converges to the oracle estimator. As the dimension of the auxiliary data increases, we accurately quantify the improvements in estimation risk and the associated deterioration in convergence rate. The numerical performance of NIT is illustrated through the analysis of both simulated and real data, demonstrating its superiority over existing methods.
format Preprint
id arxiv_https___arxiv_org_abs_2308_05883
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Empirical Bayes Estimation with Side Information: A Nonparametric Integrative Tweedie Approach
Luo, Jiajun
Banerjee, Trambak
Mukherjee, Gourab
Sun, Wenguang
Methodology
Machine Learning
We investigate the problem of compound estimation of normal means while accounting for the presence of side information. Leveraging the empirical Bayes framework, we develop a nonparametric integrative Tweedie (NIT) approach that incorporates structural knowledge encoded in multivariate auxiliary data to enhance the precision of compound estimation. Our approach employs convex optimization tools to estimate the gradient of the log-density directly, enabling the incorporation of structural constraints. We conduct theoretical analyses of the asymptotic risk of NIT and establish the rate at which NIT converges to the oracle estimator. As the dimension of the auxiliary data increases, we accurately quantify the improvements in estimation risk and the associated deterioration in convergence rate. The numerical performance of NIT is illustrated through the analysis of both simulated and real data, demonstrating its superiority over existing methods.
title Empirical Bayes Estimation with Side Information: A Nonparametric Integrative Tweedie Approach
topic Methodology
Machine Learning
url https://arxiv.org/abs/2308.05883