EfficientIML: Efficient High-Resolution Image Manipulation Localization

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Li, Jinhan, He, Haoyang, Xie, Lei, Zhang, Jiangning
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914031396192256
author Li, Jinhan
He, Haoyang
Xie, Lei
Zhang, Jiangning
author_facet Li, Jinhan
He, Haoyang
Xie, Lei
Zhang, Jiangning
contents With imaging devices delivering ever-higher resolutions and the emerging diffusion-based forgery methods, current detectors trained only on traditional datasets (with splicing, copy-moving and object removal forgeries) lack exposure to this new manipulation type. To address this, we propose a novel high-resolution SIF dataset of 1200+ diffusion-generated manipulations with semantically extracted masks. However, this also imposes a challenge on existing methods, as they face significant computational resource constraints due to their prohibitive computational complexities. Therefore, we propose a novel EfficientIML model with a lightweight, three-stage EfficientRWKV backbone. EfficientRWKV's hybrid state-space and attention network captures global context and local details in parallel, while a multi-scale supervision strategy enforces consistency across hierarchical predictions. Extensive evaluations on our dataset and standard benchmarks demonstrate that our approach outperforms ViT-based and other SOTA lightweight baselines in localization performance, FLOPs and inference speed, underscoring its suitability for real-time forensic applications.
format Preprint
id arxiv_https___arxiv_org_abs_2509_08583
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle EfficientIML: Efficient High-Resolution Image Manipulation Localization
Li, Jinhan
He, Haoyang
Xie, Lei
Zhang, Jiangning
Computer Vision and Pattern Recognition
With imaging devices delivering ever-higher resolutions and the emerging diffusion-based forgery methods, current detectors trained only on traditional datasets (with splicing, copy-moving and object removal forgeries) lack exposure to this new manipulation type. To address this, we propose a novel high-resolution SIF dataset of 1200+ diffusion-generated manipulations with semantically extracted masks. However, this also imposes a challenge on existing methods, as they face significant computational resource constraints due to their prohibitive computational complexities. Therefore, we propose a novel EfficientIML model with a lightweight, three-stage EfficientRWKV backbone. EfficientRWKV's hybrid state-space and attention network captures global context and local details in parallel, while a multi-scale supervision strategy enforces consistency across hierarchical predictions. Extensive evaluations on our dataset and standard benchmarks demonstrate that our approach outperforms ViT-based and other SOTA lightweight baselines in localization performance, FLOPs and inference speed, underscoring its suitability for real-time forensic applications.
title EfficientIML: Efficient High-Resolution Image Manipulation Localization
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.08583