Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2505.04643 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912365961805824 |
|---|---|
| author | Waldetoft, Hannes Torgander, Jakob Magnusson, Måns |
| author_facet | Waldetoft, Hannes Torgander, Jakob Magnusson, Måns |
| contents | Estimating population parameters in finite populations of text documents can be challenging when obtaining the labels for the target variable requires manual annotation. To address this problem, we combine predictions from a transformer encoder neural network with well-established survey sampling estimators using the model predictions as an auxiliary variable. The applicability is demonstrated in Swedish hate crime statistics based on Swedish police reports. Estimates of the yearly number of hate crimes and the police's under-reporting are derived using the Hansen-Hurwitz estimator, difference estimation, and stratified random sampling estimation. We conclude that if labeled training data is available, the proposed method can provide very efficient estimates with reduced time spent on manual annotation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_04643 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Prediction-powered estimators for finite population statistics in highly imbalanced textual data: Public hate crime estimation Waldetoft, Hannes Torgander, Jakob Magnusson, Måns Computation and Language Machine Learning Estimating population parameters in finite populations of text documents can be challenging when obtaining the labels for the target variable requires manual annotation. To address this problem, we combine predictions from a transformer encoder neural network with well-established survey sampling estimators using the model predictions as an auxiliary variable. The applicability is demonstrated in Swedish hate crime statistics based on Swedish police reports. Estimates of the yearly number of hate crimes and the police's under-reporting are derived using the Hansen-Hurwitz estimator, difference estimation, and stratified random sampling estimation. We conclude that if labeled training data is available, the proposed method can provide very efficient estimates with reduced time spent on manual annotation. |
| title | Prediction-powered estimators for finite population statistics in highly imbalanced textual data: Public hate crime estimation |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2505.04643 |