Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2406.01489 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910470294732800 |
|---|---|
| author | Liu, Yang Li, Xiaofei Zhang, Jun Hu, Shengze Lei, Jun |
| author_facet | Liu, Yang Li, Xiaofei Zhang, Jun Hu, Shengze Lei, Jun |
| contents | The increasing difficulty in accurately detecting forged images generated by AIGC(Artificial Intelligence Generative Content) poses many risks, necessitating the development of effective methods to identify and further locate forged areas. In this paper, to facilitate research efforts, we construct a DA-HFNet forged image dataset guided by text or image-assisted GAN and Diffusion model. Our goal is to utilize a hierarchical progressive network to capture forged artifacts at different scales for detection and localization. Specifically, it relies on a dual-attention mechanism to adaptively fuse multi-modal image features in depth, followed by a multi-branch interaction network to thoroughly interact image features at different scales and improve detector performance by leveraging dependencies between layers. Additionally, we extract more sensitive noise fingerprints to obtain more prominent forged artifact features in the forged areas. Extensive experiments validate the effectiveness of our approach, demonstrating significant performance improvements compared to state-of-the-art methods for forged image detection and localization.The code and dataset will be released in the future. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_01489 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | DA-HFNet: Progressive Fine-Grained Forgery Image Detection and Localization Based on Dual Attention Liu, Yang Li, Xiaofei Zhang, Jun Hu, Shengze Lei, Jun Computer Vision and Pattern Recognition The increasing difficulty in accurately detecting forged images generated by AIGC(Artificial Intelligence Generative Content) poses many risks, necessitating the development of effective methods to identify and further locate forged areas. In this paper, to facilitate research efforts, we construct a DA-HFNet forged image dataset guided by text or image-assisted GAN and Diffusion model. Our goal is to utilize a hierarchical progressive network to capture forged artifacts at different scales for detection and localization. Specifically, it relies on a dual-attention mechanism to adaptively fuse multi-modal image features in depth, followed by a multi-branch interaction network to thoroughly interact image features at different scales and improve detector performance by leveraging dependencies between layers. Additionally, we extract more sensitive noise fingerprints to obtain more prominent forged artifact features in the forged areas. Extensive experiments validate the effectiveness of our approach, demonstrating significant performance improvements compared to state-of-the-art methods for forged image detection and localization.The code and dataset will be released in the future. |
| title | DA-HFNet: Progressive Fine-Grained Forgery Image Detection and Localization Based on Dual Attention |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2406.01489 |