Comparison of Multilingual and Bilingual Models for Satirical News Detection of Arabic and English
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917839380676608 |
|---|---|
| author | Abdalla, Omar W. Joshi, Aditya Masood, Rahat Kanhere, Salil S. |
| author_facet | Abdalla, Omar W. Joshi, Aditya Masood, Rahat Kanhere, Salil S. |
| contents | Satirical news is real news combined with a humorous comment or exaggerated content, and it often mimics the format and style of real news. However, satirical news is often misunderstood as misinformation, especially by individuals from different cultural and social backgrounds. This research addresses the challenge of distinguishing satire from truthful news by leveraging multilingual satire detection methods in English and Arabic. We explore both zero-shot and chain-of-thought (CoT) prompting using two language models, Jais-chat(13B) and LLaMA-2-chat(7B). Our results show that CoT prompting offers a significant advantage for the Jais-chat model over the LLaMA-2-chat model. Specifically, Jais-chat achieved the best performance, with an F1-score of 80\% in English when using CoT prompting. These results highlight the importance of structured reasoning in CoT, which enhances contextual understanding and is vital for complex tasks like satire detection. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_10730 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Comparison of Multilingual and Bilingual Models for Satirical News Detection of Arabic and English Abdalla, Omar W. Joshi, Aditya Masood, Rahat Kanhere, Salil S. Computation and Language Cryptography and Security Satirical news is real news combined with a humorous comment or exaggerated content, and it often mimics the format and style of real news. However, satirical news is often misunderstood as misinformation, especially by individuals from different cultural and social backgrounds. This research addresses the challenge of distinguishing satire from truthful news by leveraging multilingual satire detection methods in English and Arabic. We explore both zero-shot and chain-of-thought (CoT) prompting using two language models, Jais-chat(13B) and LLaMA-2-chat(7B). Our results show that CoT prompting offers a significant advantage for the Jais-chat model over the LLaMA-2-chat model. Specifically, Jais-chat achieved the best performance, with an F1-score of 80\% in English when using CoT prompting. These results highlight the importance of structured reasoning in CoT, which enhances contextual understanding and is vital for complex tasks like satire detection. |
| title | Comparison of Multilingual and Bilingual Models for Satirical News Detection of Arabic and English |
| topic | Computation and Language Cryptography and Security |
| url | https://arxiv.org/abs/2411.10730 |