Functional Generalized Empirical Likelihood Estimation for Conditional Moment Restrictions
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2022
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866914680499339264 |
|---|---|
| author | Kremer, Heiner Zhu, Jia-Jie Muandet, Krikamol Schölkopf, Bernhard |
| author_facet | Kremer, Heiner Zhu, Jia-Jie Muandet, Krikamol Schölkopf, Bernhard |
| contents | Important problems in causal inference, economics, and, more generally, robust machine learning can be expressed as conditional moment restrictions, but estimation becomes challenging as it requires solving a continuum of unconditional moment restrictions. Previous works addressed this problem by extending the generalized method of moments (GMM) to continuum moment restrictions. In contrast, generalized empirical likelihood (GEL) provides a more general framework and has been shown to enjoy favorable small-sample properties compared to GMM-based estimators. To benefit from recent developments in machine learning, we provide a functional reformulation of GEL in which arbitrary models can be leveraged. Motivated by a dual formulation of the resulting infinite dimensional optimization problem, we devise a practical method and explore its asymptotic properties. Finally, we provide kernel- and neural network-based implementations of the estimator, which achieve state-of-the-art empirical performance on two conditional moment restriction problems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2207_04771 |
| institution | arXiv |
| publishDate | 2022 |
| record_format | arxiv |
| spellingShingle | Functional Generalized Empirical Likelihood Estimation for Conditional Moment Restrictions Kremer, Heiner Zhu, Jia-Jie Muandet, Krikamol Schölkopf, Bernhard Machine Learning Statistics Theory Important problems in causal inference, economics, and, more generally, robust machine learning can be expressed as conditional moment restrictions, but estimation becomes challenging as it requires solving a continuum of unconditional moment restrictions. Previous works addressed this problem by extending the generalized method of moments (GMM) to continuum moment restrictions. In contrast, generalized empirical likelihood (GEL) provides a more general framework and has been shown to enjoy favorable small-sample properties compared to GMM-based estimators. To benefit from recent developments in machine learning, we provide a functional reformulation of GEL in which arbitrary models can be leveraged. Motivated by a dual formulation of the resulting infinite dimensional optimization problem, we devise a practical method and explore its asymptotic properties. Finally, we provide kernel- and neural network-based implementations of the estimator, which achieve state-of-the-art empirical performance on two conditional moment restriction problems. |
| title | Functional Generalized Empirical Likelihood Estimation for Conditional Moment Restrictions |
| topic | Machine Learning Statistics Theory |
| url | https://arxiv.org/abs/2207.04771 |