Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2604.17694 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908978414354432 |
|---|---|
| author | Williams, Nicholas Schuler, Alejandro |
| author_facet | Williams, Nicholas Schuler, Alejandro |
| contents | Predictions from machine learning algorithms can vary across random seeds, inducing instability in downstream debiased machine learning estimators. We formalize random seed stability via a concentration condition and prove that subbagging guarantees stability for any bounded-outcome regression algorithm. We introduce a new cross-fitting procedure, adaptive cross-bagging, which simultaneously eliminates seed dependence from both nuisance estimation and sample splitting in debiased machine learning. Numerical experiments confirm that the method achieves the targeted level of stability whereas alternatives do not. Our method incurs a small computational penalty relative to standard practice whereas alternative methods incur large penalties. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_17694 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Improving reproducibility by controlling random seed stability in machine learning based estimation via bagging Williams, Nicholas Schuler, Alejandro Methodology Machine Learning Predictions from machine learning algorithms can vary across random seeds, inducing instability in downstream debiased machine learning estimators. We formalize random seed stability via a concentration condition and prove that subbagging guarantees stability for any bounded-outcome regression algorithm. We introduce a new cross-fitting procedure, adaptive cross-bagging, which simultaneously eliminates seed dependence from both nuisance estimation and sample splitting in debiased machine learning. Numerical experiments confirm that the method achieves the targeted level of stability whereas alternatives do not. Our method incurs a small computational penalty relative to standard practice whereas alternative methods incur large penalties. |
| title | Improving reproducibility by controlling random seed stability in machine learning based estimation via bagging |
| topic | Methodology Machine Learning |
| url | https://arxiv.org/abs/2604.17694 |