Optimism, Expectation, or Sarcasm? Multi-Class Hope Speech Detection in Spanish and English
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912361930031104 |
|---|---|
| author | Butt, Sabur Balouchzahi, Fazlourrahman Amjad, Ahmad Imam Amjad, Maaz Ceballos, Hector G. Jimenez-Zafra, Salud Maria |
| author_facet | Butt, Sabur Balouchzahi, Fazlourrahman Amjad, Ahmad Imam Amjad, Maaz Ceballos, Hector G. Jimenez-Zafra, Salud Maria |
| contents | Hope is a complex and underexplored emotional state that plays a significant role in education, mental health, and social interaction. Unlike basic emotions, hope manifests in nuanced forms ranging from grounded optimism to exaggerated wishfulness or sarcasm, making it difficult for Natural Language Processing systems to detect accurately. This study introduces PolyHope V2, a multilingual, fine-grained hope speech dataset comprising over 30,000 annotated tweets in English and Spanish. This resource distinguishes between four hope subtypes Generalized, Realistic, Unrealistic, and Sarcastic and enhances existing datasets by explicitly labeling sarcastic instances. We benchmark multiple pretrained transformer models and compare them with large language models (LLMs) such as GPT 4 and Llama 3 under zero-shot and few-shot regimes. Our findings show that fine-tuned transformers outperform prompt-based LLMs, especially in distinguishing nuanced hope categories and sarcasm. Through qualitative analysis and confusion matrices, we highlight systematic challenges in separating closely related hope subtypes. The dataset and results provide a robust foundation for future emotion recognition tasks that demand greater semantic and contextual sensitivity across languages. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_17974 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Optimism, Expectation, or Sarcasm? Multi-Class Hope Speech Detection in Spanish and English Butt, Sabur Balouchzahi, Fazlourrahman Amjad, Ahmad Imam Amjad, Maaz Ceballos, Hector G. Jimenez-Zafra, Salud Maria Computation and Language Hope is a complex and underexplored emotional state that plays a significant role in education, mental health, and social interaction. Unlike basic emotions, hope manifests in nuanced forms ranging from grounded optimism to exaggerated wishfulness or sarcasm, making it difficult for Natural Language Processing systems to detect accurately. This study introduces PolyHope V2, a multilingual, fine-grained hope speech dataset comprising over 30,000 annotated tweets in English and Spanish. This resource distinguishes between four hope subtypes Generalized, Realistic, Unrealistic, and Sarcastic and enhances existing datasets by explicitly labeling sarcastic instances. We benchmark multiple pretrained transformer models and compare them with large language models (LLMs) such as GPT 4 and Llama 3 under zero-shot and few-shot regimes. Our findings show that fine-tuned transformers outperform prompt-based LLMs, especially in distinguishing nuanced hope categories and sarcasm. Through qualitative analysis and confusion matrices, we highlight systematic challenges in separating closely related hope subtypes. The dataset and results provide a robust foundation for future emotion recognition tasks that demand greater semantic and contextual sensitivity across languages. |
| title | Optimism, Expectation, or Sarcasm? Multi-Class Hope Speech Detection in Spanish and English |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2504.17974 |