Prediction-powered estimators for finite population statistics in highly imbalanced textual data: Public hate crime estimation
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866912365961805824 |
|---|---|
| author | Waldetoft, Hannes Torgander, Jakob Magnusson, Måns |
| author_facet | Waldetoft, Hannes Torgander, Jakob Magnusson, Måns |
| contents | Estimating population parameters in finite populations of text documents can be challenging when obtaining the labels for the target variable requires manual annotation. To address this problem, we combine predictions from a transformer encoder neural network with well-established survey sampling estimators using the model predictions as an auxiliary variable. The applicability is demonstrated in Swedish hate crime statistics based on Swedish police reports. Estimates of the yearly number of hate crimes and the police's under-reporting are derived using the Hansen-Hurwitz estimator, difference estimation, and stratified random sampling estimation. We conclude that if labeled training data is available, the proposed method can provide very efficient estimates with reduced time spent on manual annotation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_04643 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Prediction-powered estimators for finite population statistics in highly imbalanced textual data: Public hate crime estimation Waldetoft, Hannes Torgander, Jakob Magnusson, Måns Computation and Language Machine Learning Estimating population parameters in finite populations of text documents can be challenging when obtaining the labels for the target variable requires manual annotation. To address this problem, we combine predictions from a transformer encoder neural network with well-established survey sampling estimators using the model predictions as an auxiliary variable. The applicability is demonstrated in Swedish hate crime statistics based on Swedish police reports. Estimates of the yearly number of hate crimes and the police's under-reporting are derived using the Hansen-Hurwitz estimator, difference estimation, and stratified random sampling estimation. We conclude that if labeled training data is available, the proposed method can provide very efficient estimates with reduced time spent on manual annotation. |
| title | Prediction-powered estimators for finite population statistics in highly imbalanced textual data: Public hate crime estimation |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2505.04643 |