SLIM: Semantic-based Low-bitrate Image compression for Machines by leveraging diffusion

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lee, Hyeonjin, Kim, Jun-Hyuk, Lee, Jong-Seok
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909974371762176
author Lee, Hyeonjin
Kim, Jun-Hyuk
Lee, Jong-Seok
author_facet Lee, Hyeonjin
Kim, Jun-Hyuk
Lee, Jong-Seok
contents In recent years, the demand of image compression models for machine vision has increased dramatically. However, the training frameworks of image compression still focus on the vision of human, maintaining the excessive perceptual details, thus have limitations in optimally reducing the bits per pixel in the case of performing machine vision tasks. In this paper, we propose Semantic-based Low-bitrate Image compression for Machines by leveraging diffusion, termed SLIM. This is a new effective training framework of image compression for machine vision, using a pretrained latent diffusion model.The compressor model of our method focuses only on the Region-of-Interest (RoI) areas for machine vision in the image latent, to compress it compactly. Then the pretrained Unet model enhances the decompressed latent, utilizing a RoI-focused text caption which containing semantic information of the image. Therefore, SLIM is able to focus on RoI areas of the image without any guide mask at the inference stage, achieving low bitrate when compressing. And SLIM is also able to enhance a decompressed latent by denoising steps, so the final reconstructed image from the enhanced latent can be optimized for the machine vision task while still containing perceptual details for human vision. Experimental results show that SLIM achieves a higher classification accuracy in the same bits per pixel condition, compared to conventional image compression models for machines.
format Preprint
id arxiv_https___arxiv_org_abs_2512_18200
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SLIM: Semantic-based Low-bitrate Image compression for Machines by leveraging diffusion
Lee, Hyeonjin
Kim, Jun-Hyuk
Lee, Jong-Seok
Image and Video Processing
Computer Vision and Pattern Recognition
In recent years, the demand of image compression models for machine vision has increased dramatically. However, the training frameworks of image compression still focus on the vision of human, maintaining the excessive perceptual details, thus have limitations in optimally reducing the bits per pixel in the case of performing machine vision tasks. In this paper, we propose Semantic-based Low-bitrate Image compression for Machines by leveraging diffusion, termed SLIM. This is a new effective training framework of image compression for machine vision, using a pretrained latent diffusion model.The compressor model of our method focuses only on the Region-of-Interest (RoI) areas for machine vision in the image latent, to compress it compactly. Then the pretrained Unet model enhances the decompressed latent, utilizing a RoI-focused text caption which containing semantic information of the image. Therefore, SLIM is able to focus on RoI areas of the image without any guide mask at the inference stage, achieving low bitrate when compressing. And SLIM is also able to enhance a decompressed latent by denoising steps, so the final reconstructed image from the enhanced latent can be optimized for the machine vision task while still containing perceptual details for human vision. Experimental results show that SLIM achieves a higher classification accuracy in the same bits per pixel condition, compared to conventional image compression models for machines.
title SLIM: Semantic-based Low-bitrate Image compression for Machines by leveraging diffusion
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2512.18200