IMDL-BenCo: A Comprehensive Benchmark and Codebase for Image Manipulation Detection & Localization
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917830920765440 |
|---|---|
| author | Ma, Xiaochen Zhu, Xuekang Su, Lei Du, Bo Jiang, Zhuohang Tong, Bingkui Lei, Zeyu Yang, Xinyu Pun, Chi-Man Lv, Jiancheng Zhou, Jizhe |
| author_facet | Ma, Xiaochen Zhu, Xuekang Su, Lei Du, Bo Jiang, Zhuohang Tong, Bingkui Lei, Zeyu Yang, Xinyu Pun, Chi-Man Lv, Jiancheng Zhou, Jizhe |
| contents | A comprehensive benchmark is yet to be established in the Image Manipulation Detection & Localization (IMDL) field. The absence of such a benchmark leads to insufficient and misleading model evaluations, severely undermining the development of this field. However, the scarcity of open-sourced baseline models and inconsistent training and evaluation protocols make conducting rigorous experiments and faithful comparisons among IMDL models challenging. To address these challenges, we introduce IMDL-BenCo, the first comprehensive IMDL benchmark and modular codebase. IMDL-BenCo: i) decomposes the IMDL framework into standardized, reusable components and revises the model construction pipeline, improving coding efficiency and customization flexibility; ii) fully implements or incorporates training code for state-of-the-art models to establish a comprehensive IMDL benchmark; and iii) conducts deep analysis based on the established benchmark and codebase, offering new insights into IMDL model architecture, dataset characteristics, and evaluation standards. Specifically, IMDL-BenCo includes common processing algorithms, 8 state-of-the-art IMDL models (1 of which are reproduced from scratch), 2 sets of standard training and evaluation protocols, 15 GPU-accelerated evaluation metrics, and 3 kinds of robustness evaluation. This benchmark and codebase represent a significant leap forward in calibrating the current progress in the IMDL field and inspiring future breakthroughs. Code is available at: https://github.com/scu-zjz/IMDLBenCo. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_10580 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | IMDL-BenCo: A Comprehensive Benchmark and Codebase for Image Manipulation Detection & Localization Ma, Xiaochen Zhu, Xuekang Su, Lei Du, Bo Jiang, Zhuohang Tong, Bingkui Lei, Zeyu Yang, Xinyu Pun, Chi-Man Lv, Jiancheng Zhou, Jizhe Computer Vision and Pattern Recognition A comprehensive benchmark is yet to be established in the Image Manipulation Detection & Localization (IMDL) field. The absence of such a benchmark leads to insufficient and misleading model evaluations, severely undermining the development of this field. However, the scarcity of open-sourced baseline models and inconsistent training and evaluation protocols make conducting rigorous experiments and faithful comparisons among IMDL models challenging. To address these challenges, we introduce IMDL-BenCo, the first comprehensive IMDL benchmark and modular codebase. IMDL-BenCo: i) decomposes the IMDL framework into standardized, reusable components and revises the model construction pipeline, improving coding efficiency and customization flexibility; ii) fully implements or incorporates training code for state-of-the-art models to establish a comprehensive IMDL benchmark; and iii) conducts deep analysis based on the established benchmark and codebase, offering new insights into IMDL model architecture, dataset characteristics, and evaluation standards. Specifically, IMDL-BenCo includes common processing algorithms, 8 state-of-the-art IMDL models (1 of which are reproduced from scratch), 2 sets of standard training and evaluation protocols, 15 GPU-accelerated evaluation metrics, and 3 kinds of robustness evaluation. This benchmark and codebase represent a significant leap forward in calibrating the current progress in the IMDL field and inspiring future breakthroughs. Code is available at: https://github.com/scu-zjz/IMDLBenCo. |
| title | IMDL-BenCo: A Comprehensive Benchmark and Codebase for Image Manipulation Detection & Localization |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2406.10580 |