LLM-guided Semi-Supervised Approaches for Social Media Crisis Data Classification
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915995811053568 |
|---|---|
| author | Ativo, Jacob Balasubramaniyam, Bharaneeshwar Tran, Anh Gupta, Khushboo Li, Hongmin Caragea, Doina Caragea, Cornelia |
| author_facet | Ativo, Jacob Balasubramaniyam, Bharaneeshwar Tran, Anh Gupta, Khushboo Li, Hongmin Caragea, Doina Caragea, Cornelia |
| contents | Semi-supervised learning approaches have been investigated as a means to enhance the analysis of social media data in disaster management contexts. In this work, we present the first empirical evaluation of large language model (LLM) guided semi-supervised learning for crisis related tweet classification. We compare two recent LLM assisted semi-supervised methods, VerifyMatch and LLM guided Co-Training ( LG-CoTrain), against established semi-supervised baselines. Our results show that LG-CoTrain significantly outperforms classical semi-supervised approaches in low resource settings with 5, 10 and 25 labeled examples per class, achieving the highest averaged Macro F1 across events. VerifyMatch achieves competitive performance while also demonstrating strong calibration properties. As the number of labeled examples increases, the performance gap narrows and Self Training emerges as a strong baseline. We further observe that compact semi-supervised models can, in some cases, outperform very large LLMs operating in zero-shot settings. This finding highlights the potential of transferring knowledge from LLMs into smaller and more deployable models through LLM guided semi-supervised learning, offering a practical pathway for real world disaster response applications. Our project repository on Github is here. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_08448 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | LLM-guided Semi-Supervised Approaches for Social Media Crisis Data Classification Ativo, Jacob Balasubramaniyam, Bharaneeshwar Tran, Anh Gupta, Khushboo Li, Hongmin Caragea, Doina Caragea, Cornelia Artificial Intelligence Computation and Language Semi-supervised learning approaches have been investigated as a means to enhance the analysis of social media data in disaster management contexts. In this work, we present the first empirical evaluation of large language model (LLM) guided semi-supervised learning for crisis related tweet classification. We compare two recent LLM assisted semi-supervised methods, VerifyMatch and LLM guided Co-Training ( LG-CoTrain), against established semi-supervised baselines. Our results show that LG-CoTrain significantly outperforms classical semi-supervised approaches in low resource settings with 5, 10 and 25 labeled examples per class, achieving the highest averaged Macro F1 across events. VerifyMatch achieves competitive performance while also demonstrating strong calibration properties. As the number of labeled examples increases, the performance gap narrows and Self Training emerges as a strong baseline. We further observe that compact semi-supervised models can, in some cases, outperform very large LLMs operating in zero-shot settings. This finding highlights the potential of transferring knowledge from LLMs into smaller and more deployable models through LLM guided semi-supervised learning, offering a practical pathway for real world disaster response applications. Our project repository on Github is here. |
| title | LLM-guided Semi-Supervised Approaches for Social Media Crisis Data Classification |
| topic | Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2605.08448 |