SODiff: Semantic-Oriented Diffusion Model for JPEG Compression Artifacts Removal

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Yang, Tingyu, Gong, Jue, Guo, Jinpei, Li, Wenbo, Guo, Yong, Zhang, Yulun
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913982965612544
author Yang, Tingyu
Gong, Jue
Guo, Jinpei
Li, Wenbo
Guo, Yong
Zhang, Yulun
author_facet Yang, Tingyu
Gong, Jue
Guo, Jinpei
Li, Wenbo
Guo, Yong
Zhang, Yulun
contents JPEG, as a widely used image compression standard, often introduces severe visual artifacts when achieving high compression ratios. Although existing deep learning-based restoration methods have made considerable progress, they often struggle to recover complex texture details, resulting in over-smoothed outputs. To overcome these limitations, we propose SODiff, a novel and efficient semantic-oriented one-step diffusion model for JPEG artifacts removal. Our core idea is that effective restoration hinges on providing semantic-oriented guidance to the pre-trained diffusion model, thereby fully leveraging its powerful generative prior. To this end, SODiff incorporates a semantic-aligned image prompt extractor (SAIPE). SAIPE extracts rich features from low-quality (LQ) images and projects them into an embedding space semantically aligned with that of the text encoder. Simultaneously, it preserves crucial information for faithful reconstruction. Furthermore, we propose a quality factor-aware time predictor that implicitly learns the compression quality factor (QF) of the LQ image and adaptively selects the optimal denoising start timestep for the diffusion process. Extensive experimental results show that our SODiff outperforms recent leading methods in both visual quality and quantitative metrics. Code is available at: https://github.com/frakenation/SODiff
format Preprint
id arxiv_https___arxiv_org_abs_2508_07346
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SODiff: Semantic-Oriented Diffusion Model for JPEG Compression Artifacts Removal
Yang, Tingyu
Gong, Jue
Guo, Jinpei
Li, Wenbo
Guo, Yong
Zhang, Yulun
Computer Vision and Pattern Recognition
JPEG, as a widely used image compression standard, often introduces severe visual artifacts when achieving high compression ratios. Although existing deep learning-based restoration methods have made considerable progress, they often struggle to recover complex texture details, resulting in over-smoothed outputs. To overcome these limitations, we propose SODiff, a novel and efficient semantic-oriented one-step diffusion model for JPEG artifacts removal. Our core idea is that effective restoration hinges on providing semantic-oriented guidance to the pre-trained diffusion model, thereby fully leveraging its powerful generative prior. To this end, SODiff incorporates a semantic-aligned image prompt extractor (SAIPE). SAIPE extracts rich features from low-quality (LQ) images and projects them into an embedding space semantically aligned with that of the text encoder. Simultaneously, it preserves crucial information for faithful reconstruction. Furthermore, we propose a quality factor-aware time predictor that implicitly learns the compression quality factor (QF) of the LQ image and adaptively selects the optimal denoising start timestep for the diffusion process. Extensive experimental results show that our SODiff outperforms recent leading methods in both visual quality and quantitative metrics. Code is available at: https://github.com/frakenation/SODiff
title SODiff: Semantic-Oriented Diffusion Model for JPEG Compression Artifacts Removal
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2508.07346