Saved in:
Bibliographic Details
Main Authors: Pigini, Claudia, Pionati, Alessandro, Valentini, Francesco
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2502.06446
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911251414646784
author Pigini, Claudia
Pionati, Alessandro
Valentini, Francesco
author_facet Pigini, Claudia
Pionati, Alessandro
Valentini, Francesco
contents We study the application of the grouped fixed effects approach to binary choice models for panel data in presence of severe complete separation. Through data loss, complete separation may lead to biased estimates of Average Partial Effects and imprecise inference. Moreover, forecasts are not available for units without variability in the response configuration. The grouped fixed effects approach discretizes unobserved heterogeneity via k-means clustering, thus reducing the number of fixed effects to estimate. This regularization reduces complete separation, since it relies on within-cluster rather than within-subject response transitions. Drawing from asymptotic theory for the APEs, we propose choosing a number of groups such that clustering delivers a good approximation of the latent trait while keeping the incidental parameters problem under control. The simulation results show that the proposed approach delivers unbiased estimates and reliable inference for the APEs. Two empirical applications illustrate the sensitivity of the results to the choice of the number of groups and how nontrivial forecasts for a much larger number of units can be obtained.
format Preprint
id arxiv_https___arxiv_org_abs_2502_06446
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Grouped fixed effects regularization for binary choice models
Pigini, Claudia
Pionati, Alessandro
Valentini, Francesco
Econometrics
We study the application of the grouped fixed effects approach to binary choice models for panel data in presence of severe complete separation. Through data loss, complete separation may lead to biased estimates of Average Partial Effects and imprecise inference. Moreover, forecasts are not available for units without variability in the response configuration. The grouped fixed effects approach discretizes unobserved heterogeneity via k-means clustering, thus reducing the number of fixed effects to estimate. This regularization reduces complete separation, since it relies on within-cluster rather than within-subject response transitions. Drawing from asymptotic theory for the APEs, we propose choosing a number of groups such that clustering delivers a good approximation of the latent trait while keeping the incidental parameters problem under control. The simulation results show that the proposed approach delivers unbiased estimates and reliable inference for the APEs. Two empirical applications illustrate the sensitivity of the results to the choice of the number of groups and how nontrivial forecasts for a much larger number of units can be obtained.
title Grouped fixed effects regularization for binary choice models
topic Econometrics
url https://arxiv.org/abs/2502.06446