Improving optimal subsampling through stratification

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yang, Jasper B., Lumley, Thomas, Shepherd, Bryan E., Shaw, Pamela A.
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911336112324608
author Yang, Jasper B.
Lumley, Thomas
Shepherd, Bryan E.
Shaw, Pamela A.
author_facet Yang, Jasper B.
Lumley, Thomas
Shepherd, Bryan E.
Shaw, Pamela A.
contents Recent works have proposed optimal subsampling algorithms to improve computational efficiency in large datasets and to design validation studies in the presence of measurement error. Existing approaches generally fall into two categories: (i) designs that optimize individualized sampling rules, where unit-specific probabilities are assigned and applied independently, and (ii) designs based on stratified sampling with simple random sampling within strata. Focusing on the logistic regression setting, we derive the asymptotic variances of estimators under both approaches and compare them numerically through extensive simulations and an application to data from the Vanderbilt Comprehensive Care Clinic cohort. Our results reinforce that stratified sampling is not merely an approximation to individualized sampling, showing instead that optimal stratified designs are often more efficient than optimal individualized designs through their elimination of between-stratum contributions to variance. These findings suggest that optimizing over the class of individualized sampling rules overlooks highly efficient sampling designs and highlight the often underappreciated advantages of stratified sampling.
format Preprint
id arxiv_https___arxiv_org_abs_2512_20837
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Improving optimal subsampling through stratification
Yang, Jasper B.
Lumley, Thomas
Shepherd, Bryan E.
Shaw, Pamela A.
Methodology
Recent works have proposed optimal subsampling algorithms to improve computational efficiency in large datasets and to design validation studies in the presence of measurement error. Existing approaches generally fall into two categories: (i) designs that optimize individualized sampling rules, where unit-specific probabilities are assigned and applied independently, and (ii) designs based on stratified sampling with simple random sampling within strata. Focusing on the logistic regression setting, we derive the asymptotic variances of estimators under both approaches and compare them numerically through extensive simulations and an application to data from the Vanderbilt Comprehensive Care Clinic cohort. Our results reinforce that stratified sampling is not merely an approximation to individualized sampling, showing instead that optimal stratified designs are often more efficient than optimal individualized designs through their elimination of between-stratum contributions to variance. These findings suggest that optimizing over the class of individualized sampling rules overlooks highly efficient sampling designs and highlight the often underappreciated advantages of stratified sampling.
title Improving optimal subsampling through stratification
topic Methodology
url https://arxiv.org/abs/2512.20837