Large-dimensional Factor Analysis with Weighted PCA

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lyu, Zhongyuan, Yuan, Ming
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914000010215424
author Lyu, Zhongyuan
Yuan, Ming
author_facet Lyu, Zhongyuan
Yuan, Ming
contents Principal component analysis (PCA) is arguably the most widely used approach for large-dimensional factor analysis. While it is effective when the factors are sufficiently strong, it can be inconsistent when the factors are weak and/or the noise has complex dependence structure. We argue that the inconsistency often stems from bias and introduce a general approach to restore consistency. Specifically, we propose a general weighting scheme for PCA and show that with a suitable choice of weighting matrices, it is possible to deduce consistent and asymptotic normal estimators under much weaker conditions than the usual PCA. While the optimal weight matrix may require knowledge about the factors and covariance of the idiosyncratic noise that are not known a priori, we develop an agnostic approach to adaptively choose from a large class of weighting matrices that can be viewed as PCA for weighted linear combinations of auto-covariances among the observations. Theoretical and numerical results demonstrate the merits of our methodology over the usual PCA and other recently developed techniques for large-dimensional approximate factor models.
format Preprint
id arxiv_https___arxiv_org_abs_2508_15675
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Large-dimensional Factor Analysis with Weighted PCA
Lyu, Zhongyuan
Yuan, Ming
Methodology
Econometrics
Statistics Theory
62H25, 62E20
Principal component analysis (PCA) is arguably the most widely used approach for large-dimensional factor analysis. While it is effective when the factors are sufficiently strong, it can be inconsistent when the factors are weak and/or the noise has complex dependence structure. We argue that the inconsistency often stems from bias and introduce a general approach to restore consistency. Specifically, we propose a general weighting scheme for PCA and show that with a suitable choice of weighting matrices, it is possible to deduce consistent and asymptotic normal estimators under much weaker conditions than the usual PCA. While the optimal weight matrix may require knowledge about the factors and covariance of the idiosyncratic noise that are not known a priori, we develop an agnostic approach to adaptively choose from a large class of weighting matrices that can be viewed as PCA for weighted linear combinations of auto-covariances among the observations. Theoretical and numerical results demonstrate the merits of our methodology over the usual PCA and other recently developed techniques for large-dimensional approximate factor models.
title Large-dimensional Factor Analysis with Weighted PCA
topic Methodology
Econometrics
Statistics Theory
62H25, 62E20
url https://arxiv.org/abs/2508.15675