Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2406.07430 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916350261198848 |
|---|---|
| author | Gu, Yimeng Zhang, Mengqi Castro, Ignacio Wu, Shu Tyson, Gareth |
| author_facet | Gu, Yimeng Zhang, Mengqi Castro, Ignacio Wu, Shu Tyson, Gareth |
| contents | Out-of-context news is a common type of misinformation on online media platforms. This involves posting a caption, alongside a mismatched news image. Existing out-of-context news detection models only consider the scenario where pre-labeled data is available for each domain, failing to address the out-of-context news detection on unlabeled domains (e.g. news topics or agencies). In this work, we therefore focus on domain adaptive out-of-context news detection. In order to effectively adapt the detection model to unlabeled news topics or agencies, we propose ConDA-TTA (Contrastive Domain Adaptation with Test-Time Adaptation) which applies contrastive learning and maximum mean discrepancy (MMD) to learn domain-invariant features. In addition, we leverage test-time target domain statistics to further assist domain adaptation. Experimental results show that our approach outperforms baselines in most domain adaptation settings on two public datasets, by as much as 2.93% in F1 and 2.08% in accuracy. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_07430 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Learning Domain-Invariant Features for Out-of-Context News Detection Gu, Yimeng Zhang, Mengqi Castro, Ignacio Wu, Shu Tyson, Gareth Computation and Language Multimedia Out-of-context news is a common type of misinformation on online media platforms. This involves posting a caption, alongside a mismatched news image. Existing out-of-context news detection models only consider the scenario where pre-labeled data is available for each domain, failing to address the out-of-context news detection on unlabeled domains (e.g. news topics or agencies). In this work, we therefore focus on domain adaptive out-of-context news detection. In order to effectively adapt the detection model to unlabeled news topics or agencies, we propose ConDA-TTA (Contrastive Domain Adaptation with Test-Time Adaptation) which applies contrastive learning and maximum mean discrepancy (MMD) to learn domain-invariant features. In addition, we leverage test-time target domain statistics to further assist domain adaptation. Experimental results show that our approach outperforms baselines in most domain adaptation settings on two public datasets, by as much as 2.93% in F1 and 2.08% in accuracy. |
| title | Learning Domain-Invariant Features for Out-of-Context News Detection |
| topic | Computation and Language Multimedia |
| url | https://arxiv.org/abs/2406.07430 |