Saved in:
Bibliographic Details
Main Authors: Yu, Zeqin, Ni, Jiangqun, Zhang, Jian, Deng, Haoyi, Lin, Yuzhen
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2504.05224
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913780755070976
author Yu, Zeqin
Ni, Jiangqun
Zhang, Jian
Deng, Haoyi
Lin, Yuzhen
author_facet Yu, Zeqin
Ni, Jiangqun
Zhang, Jian
Deng, Haoyi
Lin, Yuzhen
contents Image forgery detection and localization (IFDL) is of vital importance as forged images can spread misinformation that poses potential threats to our daily lives. However, previous methods still struggled to effectively handle forged images processed with diverse forgery operations in real-world scenarios. In this paper, we propose a novel Reinforced Multi-teacher Knowledge Distillation (Re-MTKD) framework for the IFDL task, structured around an encoder-decoder \textbf{C}onvNeXt-\textbf{U}perNet along with \textbf{E}dge-Aware Module, named Cue-Net. First, three Cue-Net models are separately trained for the three main types of image forgeries, i.e., copy-move, splicing, and inpainting, which then serve as the multi-teacher models to train the target student model with Cue-Net through self-knowledge distillation. A Reinforced Dynamic Teacher Selection (Re-DTS) strategy is developed to dynamically assign weights to the involved teacher models, which facilitates specific knowledge transfer and enables the student model to effectively learn both the common and specific natures of diverse tampering traces. Extensive experiments demonstrate that, compared with other state-of-the-art methods, the proposed method achieves superior performance on several recently emerged datasets comprised of various kinds of image forgeries.
format Preprint
id arxiv_https___arxiv_org_abs_2504_05224
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Reinforced Multi-teacher Knowledge Distillation for Efficient General Image Forgery Detection and Localization
Yu, Zeqin
Ni, Jiangqun
Zhang, Jian
Deng, Haoyi
Lin, Yuzhen
Computer Vision and Pattern Recognition
Image forgery detection and localization (IFDL) is of vital importance as forged images can spread misinformation that poses potential threats to our daily lives. However, previous methods still struggled to effectively handle forged images processed with diverse forgery operations in real-world scenarios. In this paper, we propose a novel Reinforced Multi-teacher Knowledge Distillation (Re-MTKD) framework for the IFDL task, structured around an encoder-decoder \textbf{C}onvNeXt-\textbf{U}perNet along with \textbf{E}dge-Aware Module, named Cue-Net. First, three Cue-Net models are separately trained for the three main types of image forgeries, i.e., copy-move, splicing, and inpainting, which then serve as the multi-teacher models to train the target student model with Cue-Net through self-knowledge distillation. A Reinforced Dynamic Teacher Selection (Re-DTS) strategy is developed to dynamically assign weights to the involved teacher models, which facilitates specific knowledge transfer and enables the student model to effectively learn both the common and specific natures of diverse tampering traces. Extensive experiments demonstrate that, compared with other state-of-the-art methods, the proposed method achieves superior performance on several recently emerged datasets comprised of various kinds of image forgeries.
title Reinforced Multi-teacher Knowledge Distillation for Efficient General Image Forgery Detection and Localization
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.05224