StyleID: A Perception-Aware Dataset and Metric for Stylization-Agnostic Facial Identity Recognition

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yun, Kwan, Lee, Changmin, Jeong, Ayeong, Kim, Youngseo, Lee, Seungmi, Noh, Junyong
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914502396608512
author Yun, Kwan
Lee, Changmin
Jeong, Ayeong
Kim, Youngseo
Lee, Seungmi
Noh, Junyong
author_facet Yun, Kwan
Lee, Changmin
Jeong, Ayeong
Kim, Youngseo
Lee, Seungmi
Noh, Junyong
contents Creative face stylization aims to render portraits in diverse visual idioms such as cartoons, sketches, and paintings while retaining recognizable identity. However, current identity encoders, which are typically trained and calibrated on natural photographs, exhibit severe brittleness under stylization. They often mistake changes in texture or color palette for identity drift or fail to detect geometric exaggerations. This reveals the lack of a style-agnostic framework to evaluate and supervise identity consistency across varying styles and strengths. To address this gap, we introduce StyleID, a human perception-aware dataset and evaluation framework for facial identity under stylization. StyleID comprises two datasets: (i) StyleBench-H, a benchmark that captures human same-different verification judgments across diffusion- and flow-matching-based stylization at multiple style strengths, and (ii) StyleBench-S, a supervision set derived from psychometric recognition-strength curves obtained through controlled two-alternative forced-choice (2AFC) experiments. Leveraging StyleBench-S, we fine-tune existing semantic encoders to align their similarity orderings with human perception across styles and strengths. Experiments demonstrate that our calibrated models yield significantly higher correlation with human judgments and enhanced robustness for out-of-domain, artist drawn portraits. All of our datasets, code, and pretrained models are publicly available at https://kwanyun.github.io/StyleID_page/
format Preprint
id arxiv_https___arxiv_org_abs_2604_21689
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle StyleID: A Perception-Aware Dataset and Metric for Stylization-Agnostic Facial Identity Recognition
Yun, Kwan
Lee, Changmin
Jeong, Ayeong
Kim, Youngseo
Lee, Seungmi
Noh, Junyong
Graphics
Computer Vision and Pattern Recognition
Human-Computer Interaction
Multimedia
65D18
I.4.10; I.3.8
Creative face stylization aims to render portraits in diverse visual idioms such as cartoons, sketches, and paintings while retaining recognizable identity. However, current identity encoders, which are typically trained and calibrated on natural photographs, exhibit severe brittleness under stylization. They often mistake changes in texture or color palette for identity drift or fail to detect geometric exaggerations. This reveals the lack of a style-agnostic framework to evaluate and supervise identity consistency across varying styles and strengths. To address this gap, we introduce StyleID, a human perception-aware dataset and evaluation framework for facial identity under stylization. StyleID comprises two datasets: (i) StyleBench-H, a benchmark that captures human same-different verification judgments across diffusion- and flow-matching-based stylization at multiple style strengths, and (ii) StyleBench-S, a supervision set derived from psychometric recognition-strength curves obtained through controlled two-alternative forced-choice (2AFC) experiments. Leveraging StyleBench-S, we fine-tune existing semantic encoders to align their similarity orderings with human perception across styles and strengths. Experiments demonstrate that our calibrated models yield significantly higher correlation with human judgments and enhanced robustness for out-of-domain, artist drawn portraits. All of our datasets, code, and pretrained models are publicly available at https://kwanyun.github.io/StyleID_page/
title StyleID: A Perception-Aware Dataset and Metric for Stylization-Agnostic Facial Identity Recognition
topic Graphics
Computer Vision and Pattern Recognition
Human-Computer Interaction
Multimedia
65D18
I.4.10; I.3.8
url https://arxiv.org/abs/2604.21689