Saved in:
Bibliographic Details
Main Authors: Olivas-Martinez, Antonio, Rotnitzky, Andrea
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2508.17181
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914002018238464
author Olivas-Martinez, Antonio
Rotnitzky, Andrea
author_facet Olivas-Martinez, Antonio
Rotnitzky, Andrea
contents In many applications, the target parameter depends on a nuisance function defined by a conditional moment restriction, whose estimation often leads to an ill-posed inverse problem. Classical approaches, such as sieve-based GMM, approximate the restriction using a fixed set of test functions and may fail to capture important aspects of the solution. Adversarial estimators address this limitation by framing estimation as a game between an estimator and an adaptive critic. We study the class of Regularized Adversarial Stabilized (RAS) estimators that employ reproducing kernel Hilbert spaces (RKHSs) for both estimation and testing, with regularization via the RKHS norm. Our first contribution is a novel analysis that establishes finite-sample bounds for both the weak error and the root mean squared error (RMSE) of these estimators under interpretable source conditions, in contrast to existing results. Our second contribution is a detailed comparison of the assumptions underlying this RKHS-norm-regularized approach with those required for (i) RAS estimators using $\mathcal{L}^2$ penalties, and (ii) recently proposed, computationally stable Kernel Maximal Moment estimators.
format Preprint
id arxiv_https___arxiv_org_abs_2508_17181
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Source-Condition Analysis of Kernel Adversarial Estimators
Olivas-Martinez, Antonio
Rotnitzky, Andrea
Statistics Theory
In many applications, the target parameter depends on a nuisance function defined by a conditional moment restriction, whose estimation often leads to an ill-posed inverse problem. Classical approaches, such as sieve-based GMM, approximate the restriction using a fixed set of test functions and may fail to capture important aspects of the solution. Adversarial estimators address this limitation by framing estimation as a game between an estimator and an adaptive critic. We study the class of Regularized Adversarial Stabilized (RAS) estimators that employ reproducing kernel Hilbert spaces (RKHSs) for both estimation and testing, with regularization via the RKHS norm. Our first contribution is a novel analysis that establishes finite-sample bounds for both the weak error and the root mean squared error (RMSE) of these estimators under interpretable source conditions, in contrast to existing results. Our second contribution is a detailed comparison of the assumptions underlying this RKHS-norm-regularized approach with those required for (i) RAS estimators using $\mathcal{L}^2$ penalties, and (ii) recently proposed, computationally stable Kernel Maximal Moment estimators.
title Source-Condition Analysis of Kernel Adversarial Estimators
topic Statistics Theory
url https://arxiv.org/abs/2508.17181