MFGDiffusion: Mask-Guided Smoke Synthesis for Enhanced Forest Fire Detection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wu, Guanghao, Shang, Yunqing, Xu, Chen, Song, Hai, Wang, Chong, Zhang, Qixing
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908713872261120
author Wu, Guanghao
Shang, Yunqing
Xu, Chen
Song, Hai
Wang, Chong
Zhang, Qixing
author_facet Wu, Guanghao
Shang, Yunqing
Xu, Chen
Song, Hai
Wang, Chong
Zhang, Qixing
contents Smoke is the first visible indicator of a wildfire.With the advancement of deep learning, image-based smoke detection has become a crucial method for detecting and preventing forest fires. However, the scarcity of smoke image data from forest fires is one of the significant factors hindering the detection of forest fire smoke. Image generation models offer a promising solution for synthesizing realistic smoke images. However, current inpainting models exhibit limitations in generating high-quality smoke representations, particularly manifesting as inconsistencies between synthesized smoke and background contexts. To solve these problems, we proposed a comprehensive framework for generating forest fire smoke images. Firstly, we employed the pre-trained segmentation model and the multimodal model to obtain smoke masks and image captions.Then, to address the insufficient utilization of masks and masked images by inpainting models, we introduced a network architecture guided by mask and masked image features. We also proposed a new loss function, the mask random difference loss, which enhances the consistency of the generated effects around the mask by randomly expanding and eroding the mask edges.Finally, to generate a smoke image dataset using random masks for subsequent detection tasks, we incorporated smoke characteristics and use a multimodal large language model as a filtering tool to select diverse and reasonable smoke images, thereby improving the quality of the synthetic dataset. Experiments showed that our generated smoke images are realistic and diverse, and effectively enhance the performance of forest fire smoke detection models. Code is available at https://github.com/wghr123/MFGDiffusion.
format Preprint
id arxiv_https___arxiv_org_abs_2507_11252
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MFGDiffusion: Mask-Guided Smoke Synthesis for Enhanced Forest Fire Detection
Wu, Guanghao
Shang, Yunqing
Xu, Chen
Song, Hai
Wang, Chong
Zhang, Qixing
Computer Vision and Pattern Recognition
Image and Video Processing
Smoke is the first visible indicator of a wildfire.With the advancement of deep learning, image-based smoke detection has become a crucial method for detecting and preventing forest fires. However, the scarcity of smoke image data from forest fires is one of the significant factors hindering the detection of forest fire smoke. Image generation models offer a promising solution for synthesizing realistic smoke images. However, current inpainting models exhibit limitations in generating high-quality smoke representations, particularly manifesting as inconsistencies between synthesized smoke and background contexts. To solve these problems, we proposed a comprehensive framework for generating forest fire smoke images. Firstly, we employed the pre-trained segmentation model and the multimodal model to obtain smoke masks and image captions.Then, to address the insufficient utilization of masks and masked images by inpainting models, we introduced a network architecture guided by mask and masked image features. We also proposed a new loss function, the mask random difference loss, which enhances the consistency of the generated effects around the mask by randomly expanding and eroding the mask edges.Finally, to generate a smoke image dataset using random masks for subsequent detection tasks, we incorporated smoke characteristics and use a multimodal large language model as a filtering tool to select diverse and reasonable smoke images, thereby improving the quality of the synthetic dataset. Experiments showed that our generated smoke images are realistic and diverse, and effectively enhance the performance of forest fire smoke detection models. Code is available at https://github.com/wghr123/MFGDiffusion.
title MFGDiffusion: Mask-Guided Smoke Synthesis for Enhanced Forest Fire Detection
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2507.11252