Wasserstein Distortion: Unifying Fidelity and Realism

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Qiu, Yang, Wagner, Aaron B., Ballé, Johannes, Theis, Lucas
Format: Preprint
Veröffentlicht: 2023
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913289020112896
author Qiu, Yang
Wagner, Aaron B.
Ballé, Johannes
Theis, Lucas
author_facet Qiu, Yang
Wagner, Aaron B.
Ballé, Johannes
Theis, Lucas
contents We introduce a distortion measure for images, Wasserstein distortion, that simultaneously generalizes pixel-level fidelity on the one hand and realism or perceptual quality on the other. We show how Wasserstein distortion reduces to a pure fidelity constraint or a pure realism constraint under different parameter choices and discuss its metric properties. Pairs of images that are close under Wasserstein distortion illustrate its utility. In particular, we generate random textures that have high fidelity to a reference texture in one location of the image and smoothly transition to an independent realization of the texture as one moves away from this point. Wasserstein distortion attempts to generalize and unify prior work on texture generation, image realism and distortion, and models of the early human visual system, in the form of an optimizable metric in the mathematical sense.
format Preprint
id arxiv_https___arxiv_org_abs_2310_03629
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Wasserstein Distortion: Unifying Fidelity and Realism
Qiu, Yang
Wagner, Aaron B.
Ballé, Johannes
Theis, Lucas
Information Theory
Computer Vision and Pattern Recognition
Image and Video Processing
We introduce a distortion measure for images, Wasserstein distortion, that simultaneously generalizes pixel-level fidelity on the one hand and realism or perceptual quality on the other. We show how Wasserstein distortion reduces to a pure fidelity constraint or a pure realism constraint under different parameter choices and discuss its metric properties. Pairs of images that are close under Wasserstein distortion illustrate its utility. In particular, we generate random textures that have high fidelity to a reference texture in one location of the image and smoothly transition to an independent realization of the texture as one moves away from this point. Wasserstein distortion attempts to generalize and unify prior work on texture generation, image realism and distortion, and models of the early human visual system, in the form of an optimizable metric in the mathematical sense.
title Wasserstein Distortion: Unifying Fidelity and Realism
topic Information Theory
Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2310.03629