Enregistré dans:
Détails bibliographiques
Auteurs principaux: Yang, Yifan, Chen, Shuo, Wang, Ming
Format: Preprint
Publié: 2023
Sujets:
Accès en ligne:https://arxiv.org/abs/2304.08553
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916696771526656
author Yang, Yifan
Chen, Shuo
Wang, Ming
author_facet Yang, Yifan
Chen, Shuo
Wang, Ming
contents A block covariance structure is widely observed across large-scale and high-dimensional datasets in diverse fields such as biology, medicine, engineering, economics, and finance. This pattern entails partitioning a covariance matrix into uniform blocks, where each block exhibits equal variances and covariances. The importance of uniform-block structures lies in their ubiquity, interpretability, and ability to accommodate high dimensionality and data missingness. Despite their prevalence, statistical hypothesis testing under uniform-block covariance structures remains largely unexplored, and unknown statistical properties limit their application in research. To address this gap, we develop a comprehensive framework for joint hypothesis tests of both covariance and mean structures, leveraging a novel block Hadamard product representation of uniform-block matrices. Specifically, we derive closed-form likelihood ratio test statistics and information statistics, explicitly establishing their null distributions. Additionally, we perform simultaneous marginal mean tests under a procedure that controls the false discovery proportion (FDP). Extensive simulations validate the consistency between theoretical and empirical distributions of the joint test statistics, assess the performance of the proposed FDP control procedure, and evaluate the robustness of the joint test statistics against structural disruptions and missing data. Lastly, we apply our methodology to hypothesis testing in a high-dimensional imaging dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2304_08553
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Hypothesis testing under uniform-block covariance structures
Yang, Yifan
Chen, Shuo
Wang, Ming
Methodology
A block covariance structure is widely observed across large-scale and high-dimensional datasets in diverse fields such as biology, medicine, engineering, economics, and finance. This pattern entails partitioning a covariance matrix into uniform blocks, where each block exhibits equal variances and covariances. The importance of uniform-block structures lies in their ubiquity, interpretability, and ability to accommodate high dimensionality and data missingness. Despite their prevalence, statistical hypothesis testing under uniform-block covariance structures remains largely unexplored, and unknown statistical properties limit their application in research. To address this gap, we develop a comprehensive framework for joint hypothesis tests of both covariance and mean structures, leveraging a novel block Hadamard product representation of uniform-block matrices. Specifically, we derive closed-form likelihood ratio test statistics and information statistics, explicitly establishing their null distributions. Additionally, we perform simultaneous marginal mean tests under a procedure that controls the false discovery proportion (FDP). Extensive simulations validate the consistency between theoretical and empirical distributions of the joint test statistics, assess the performance of the proposed FDP control procedure, and evaluate the robustness of the joint test statistics against structural disruptions and missing data. Lastly, we apply our methodology to hypothesis testing in a high-dimensional imaging dataset.
title Hypothesis testing under uniform-block covariance structures
topic Methodology
url https://arxiv.org/abs/2304.08553