FaSDiff: Balancing Perception and Semantics in Face Compression via Stable Diffusion Priors

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhou, Yimin, Xia, Yichong, Chen, Bin, Hong, Mingyao, Li, Jiawei, Wang, Zhi, Wang, Yaowei
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908642524004352
author Zhou, Yimin
Xia, Yichong
Chen, Bin
Hong, Mingyao
Li, Jiawei
Wang, Zhi
Wang, Yaowei
author_facet Zhou, Yimin
Xia, Yichong
Chen, Bin
Hong, Mingyao
Li, Jiawei
Wang, Zhi
Wang, Yaowei
contents With the increasing deployment of facial image data across a wide range of applications, efficient compression tailored to facial semantics has become critical for both storage and transmission. While recent learning-based face image compression methods have achieved promising results, they often suffer from degraded reconstruction quality at low bit rates. Directly applying diffusion-based generative priors to this task leads to suboptimal performance in downstream machine vision tasks, primarily due to poor preservation of high-frequency details. In this work, we propose FaSDiff (\textbf{Fa}cial Image Compression with a \textbf{S}table \textbf{Diff}usion Prior), a novel diffusion-driven compression framework designed to enhance both visual fidelity and semantic consistency. FaSDiff incorporates a high-frequency-sensitive compressor to capture fine-grained details and generate robust visual prompts for guiding the diffusion model. To address low-frequency degradation, we further introduce a hybrid low-frequency enhancement module that disentangles and preserves semantic structures, enabling stable modulation of the diffusion prior during reconstruction. By jointly optimizing perceptual quality and semantic preservation, FaSDiff effectively balances human visual fidelity and machine vision accuracy. Extensive experiments demonstrate that FaSDiff outperforms state-of-the-art methods in both perceptual metrics and downstream task performance.
format Preprint
id arxiv_https___arxiv_org_abs_2505_05870
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle FaSDiff: Balancing Perception and Semantics in Face Compression via Stable Diffusion Priors
Zhou, Yimin
Xia, Yichong
Chen, Bin
Hong, Mingyao
Li, Jiawei
Wang, Zhi
Wang, Yaowei
Computer Vision and Pattern Recognition
Artificial Intelligence
Image and Video Processing
With the increasing deployment of facial image data across a wide range of applications, efficient compression tailored to facial semantics has become critical for both storage and transmission. While recent learning-based face image compression methods have achieved promising results, they often suffer from degraded reconstruction quality at low bit rates. Directly applying diffusion-based generative priors to this task leads to suboptimal performance in downstream machine vision tasks, primarily due to poor preservation of high-frequency details. In this work, we propose FaSDiff (\textbf{Fa}cial Image Compression with a \textbf{S}table \textbf{Diff}usion Prior), a novel diffusion-driven compression framework designed to enhance both visual fidelity and semantic consistency. FaSDiff incorporates a high-frequency-sensitive compressor to capture fine-grained details and generate robust visual prompts for guiding the diffusion model. To address low-frequency degradation, we further introduce a hybrid low-frequency enhancement module that disentangles and preserves semantic structures, enabling stable modulation of the diffusion prior during reconstruction. By jointly optimizing perceptual quality and semantic preservation, FaSDiff effectively balances human visual fidelity and machine vision accuracy. Extensive experiments demonstrate that FaSDiff outperforms state-of-the-art methods in both perceptual metrics and downstream task performance.
title FaSDiff: Balancing Perception and Semantics in Face Compression via Stable Diffusion Priors
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Image and Video Processing
url https://arxiv.org/abs/2505.05870