Exposing propaganda: an analysis of stylistic cues comparing human annotations and machine classification
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913243517157376 |
|---|---|
| author | Faye, Géraud Icard, Benjamin Casanova, Morgane Chanson, Julien Maine, François Bancilhon, François Gadek, Guillaume Gravier, Guillaume Égré, Paul |
| author_facet | Faye, Géraud Icard, Benjamin Casanova, Morgane Chanson, Julien Maine, François Bancilhon, François Gadek, Guillaume Gravier, Guillaume Égré, Paul |
| contents | This paper investigates the language of propaganda and its stylistic features. It presents the PPN dataset, standing for Propagandist Pseudo-News, a multisource, multilingual, multimodal dataset composed of news articles extracted from websites identified as propaganda sources by expert agencies. A limited sample from this set was randomly mixed with papers from the regular French press, and their URL masked, to conduct an annotation-experiment by humans, using 11 distinct labels. The results show that human annotators were able to reliably discriminate between the two types of press across each of the labels. We propose different NLP techniques to identify the cues used by the annotators, and to compare them with machine classification. They include the analyzer VAGO to measure discourse vagueness and subjectivity, a TF-IDF to serve as a baseline, and four different classifiers: two RoBERTa-based models, CATS using syntax, and one XGBoost combining syntactic and semantic features. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_03780 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Exposing propaganda: an analysis of stylistic cues comparing human annotations and machine classification Faye, Géraud Icard, Benjamin Casanova, Morgane Chanson, Julien Maine, François Bancilhon, François Gadek, Guillaume Gravier, Guillaume Égré, Paul Computation and Language Artificial Intelligence Machine Learning This paper investigates the language of propaganda and its stylistic features. It presents the PPN dataset, standing for Propagandist Pseudo-News, a multisource, multilingual, multimodal dataset composed of news articles extracted from websites identified as propaganda sources by expert agencies. A limited sample from this set was randomly mixed with papers from the regular French press, and their URL masked, to conduct an annotation-experiment by humans, using 11 distinct labels. The results show that human annotators were able to reliably discriminate between the two types of press across each of the labels. We propose different NLP techniques to identify the cues used by the annotators, and to compare them with machine classification. They include the analyzer VAGO to measure discourse vagueness and subjectivity, a TF-IDF to serve as a baseline, and four different classifiers: two RoBERTa-based models, CATS using syntax, and one XGBoost combining syntactic and semantic features. |
| title | Exposing propaganda: an analysis of stylistic cues comparing human annotations and machine classification |
| topic | Computation and Language Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2402.03780 |