Engineering of Hallucination in Generative AI: It's not a Bug, it's a Feature

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Fingscheidt, Tim, Blumenberg, Patrick, Möller, Björn
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908759109926912
author Fingscheidt, Tim
Blumenberg, Patrick
Möller, Björn
author_facet Fingscheidt, Tim
Blumenberg, Patrick
Möller, Björn
contents Generative artificial intelligence (AI) is conquering our lives at lightning speed. Large language models such as ChatGPT answer our questions or write texts for us, large computer vision models such as GAIA-1 generate videos on the basis of text descriptions or continue prompted videos. These neural network models are trained using large amounts of text or video data, strictly according to the real data employed in training. However, there is a surprising observation: When we use these models, they only function satisfactorily when they are allowed a certain degree of fantasy (hallucination). While hallucination usually has a negative connotation in generative AI - after all, ChatGPT is expected to give a fact-based answer! - this article recapitulates some simple means of probability engineering that can be used to encourage generative AI to hallucinate to a limited extent and thus lead to the desired results. We have to ask ourselves: Is hallucination in gen-erative AI probably not a bug, but rather a feature?
format Preprint
id arxiv_https___arxiv_org_abs_2601_07046
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Engineering of Hallucination in Generative AI: It's not a Bug, it's a Feature
Fingscheidt, Tim
Blumenberg, Patrick
Möller, Björn
Computation and Language
Generative artificial intelligence (AI) is conquering our lives at lightning speed. Large language models such as ChatGPT answer our questions or write texts for us, large computer vision models such as GAIA-1 generate videos on the basis of text descriptions or continue prompted videos. These neural network models are trained using large amounts of text or video data, strictly according to the real data employed in training. However, there is a surprising observation: When we use these models, they only function satisfactorily when they are allowed a certain degree of fantasy (hallucination). While hallucination usually has a negative connotation in generative AI - after all, ChatGPT is expected to give a fact-based answer! - this article recapitulates some simple means of probability engineering that can be used to encourage generative AI to hallucinate to a limited extent and thus lead to the desired results. We have to ask ourselves: Is hallucination in gen-erative AI probably not a bug, but rather a feature?
title Engineering of Hallucination in Generative AI: It's not a Bug, it's a Feature
topic Computation and Language
url https://arxiv.org/abs/2601.07046