Dependable Exploitation of High-Dimensional Unlabeled Data in an Assumption-Lean Framework
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914431374458880 |
|---|---|
| author | Ying, Chao Deng, Siyi Ning, Yang Zhao, Jiwei Zhang, Heping |
| author_facet | Ying, Chao Deng, Siyi Ning, Yang Zhao, Jiwei Zhang, Heping |
| contents | Semi-supervised learning has attracted significant attention due to the proliferation of applications featuring limited labeled data but abundant unlabeled data.
In this paper, we examine the statistical inference problem in an assumption-lean framework which involves a high-dimensional regression parameter, defined by minimizing the least squares, within the context of semi-supervised learning.
We investigate when and how unlabeled data can enhance the estimation efficiency of a regression parameter functional.
First, we demonstrate that a straightforward debiased estimator can only be more efficient than its supervised counterpart if the unknown conditional mean function can be consistently estimated at an appropriate rate.
Otherwise, incorporating unlabeled data can actually be counterproductive.
To address this vulnerability, we propose a novel estimator guaranteed to be at least as efficient as the supervised baseline, even when the conditional mean function is misspecified.
This ensures the dependable use of unlabeled data for statistical inference.
Finally, we extend our approach to the general M-estimation framework, and demonstrate the effectiveness of our methodology through comprehensive simulation studies and a real data application. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_27869 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Dependable Exploitation of High-Dimensional Unlabeled Data in an Assumption-Lean Framework Ying, Chao Deng, Siyi Ning, Yang Zhao, Jiwei Zhang, Heping Methodology Semi-supervised learning has attracted significant attention due to the proliferation of applications featuring limited labeled data but abundant unlabeled data. In this paper, we examine the statistical inference problem in an assumption-lean framework which involves a high-dimensional regression parameter, defined by minimizing the least squares, within the context of semi-supervised learning. We investigate when and how unlabeled data can enhance the estimation efficiency of a regression parameter functional. First, we demonstrate that a straightforward debiased estimator can only be more efficient than its supervised counterpart if the unknown conditional mean function can be consistently estimated at an appropriate rate. Otherwise, incorporating unlabeled data can actually be counterproductive. To address this vulnerability, we propose a novel estimator guaranteed to be at least as efficient as the supervised baseline, even when the conditional mean function is misspecified. This ensures the dependable use of unlabeled data for statistical inference. Finally, we extend our approach to the general M-estimation framework, and demonstrate the effectiveness of our methodology through comprehensive simulation studies and a real data application. |
| title | Dependable Exploitation of High-Dimensional Unlabeled Data in an Assumption-Lean Framework |
| topic | Methodology |
| url | https://arxiv.org/abs/2603.27869 |