Intriguing properties of generative classifiers

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Jaini, Priyank, Clark, Kevin, Geirhos, Robert
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916124607643648
author Jaini, Priyank
Clark, Kevin
Geirhos, Robert
author_facet Jaini, Priyank
Clark, Kevin
Geirhos, Robert
contents What is the best paradigm to recognize objects -- discriminative inference (fast but potentially prone to shortcut learning) or using a generative model (slow but potentially more robust)? We build on recent advances in generative modeling that turn text-to-image models into classifiers. This allows us to study their behavior and to compare them against discriminative models and human psychophysical data. We report four intriguing emergent properties of generative classifiers: they show a record-breaking human-like shape bias (99% for Imagen), near human-level out-of-distribution accuracy, state-of-the-art alignment with human classification errors, and they understand certain perceptual illusions. Our results indicate that while the current dominant paradigm for modeling human object recognition is discriminative inference, zero-shot generative models approximate human object recognition data surprisingly well.
format Preprint
id arxiv_https___arxiv_org_abs_2309_16779
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Intriguing properties of generative classifiers
Jaini, Priyank
Clark, Kevin
Geirhos, Robert
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Neurons and Cognition
What is the best paradigm to recognize objects -- discriminative inference (fast but potentially prone to shortcut learning) or using a generative model (slow but potentially more robust)? We build on recent advances in generative modeling that turn text-to-image models into classifiers. This allows us to study their behavior and to compare them against discriminative models and human psychophysical data. We report four intriguing emergent properties of generative classifiers: they show a record-breaking human-like shape bias (99% for Imagen), near human-level out-of-distribution accuracy, state-of-the-art alignment with human classification errors, and they understand certain perceptual illusions. Our results indicate that while the current dominant paradigm for modeling human object recognition is discriminative inference, zero-shot generative models approximate human object recognition data surprisingly well.
title Intriguing properties of generative classifiers
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Neurons and Cognition
url https://arxiv.org/abs/2309.16779