Exploring Saliency Bias in Manipulation Detection
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866915217798070272 |
|---|---|
| author | Krinsky, Joshua Bettis, Alan Tang, Qiuyu Moreira, Daniel Bharati, Aparna |
| author_facet | Krinsky, Joshua Bettis, Alan Tang, Qiuyu Moreira, Daniel Bharati, Aparna |
| contents | The social media-fuelled explosion of fake news and misinformation supported by tampered images has led to growth in the development of models and datasets for image manipulation detection. However, existing detection methods mostly treat media objects in isolation, without considering the impact of specific manipulations on viewer perception. Forensic datasets are usually analyzed based on the manipulation operations and corresponding pixel-based masks, but not on the semantics of the manipulation, i.e., type of scene, objects, and viewers' attention to scene content. The semantics of the manipulation play an important role in spreading misinformation through manipulated images. In an attempt to encourage further development of semantic-aware forensic approaches to understand visual misinformation, we propose a framework to analyze the trends of visual and semantic saliency in popular image manipulation datasets and their impact on detection. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_07338 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Exploring Saliency Bias in Manipulation Detection Krinsky, Joshua Bettis, Alan Tang, Qiuyu Moreira, Daniel Bharati, Aparna Computer Vision and Pattern Recognition The social media-fuelled explosion of fake news and misinformation supported by tampered images has led to growth in the development of models and datasets for image manipulation detection. However, existing detection methods mostly treat media objects in isolation, without considering the impact of specific manipulations on viewer perception. Forensic datasets are usually analyzed based on the manipulation operations and corresponding pixel-based masks, but not on the semantics of the manipulation, i.e., type of scene, objects, and viewers' attention to scene content. The semantics of the manipulation play an important role in spreading misinformation through manipulated images. In an attempt to encourage further development of semantic-aware forensic approaches to understand visual misinformation, we propose a framework to analyze the trends of visual and semantic saliency in popular image manipulation datasets and their impact on detection. |
| title | Exploring Saliency Bias in Manipulation Detection |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2402.07338 |