Does It Make Sense to Speak of Introspection in Large Language Models?

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Comsa, Iulia M., Shanahan, Murray
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909640707538944
author Comsa, Iulia M.
Shanahan, Murray
author_facet Comsa, Iulia M.
Shanahan, Murray
contents Large language models (LLMs) exhibit compelling linguistic behaviour, and sometimes offer self-reports, that is to say statements about their own nature, inner workings, or behaviour. In humans, such reports are often attributed to a faculty of introspection and are typically linked to consciousness. This raises the question of how to interpret self-reports produced by LLMs, given their increasing linguistic fluency and cognitive capabilities. To what extent (if any) can the concept of introspection be meaningfully applied to LLMs? Here, we present and critique two examples of apparent introspective self-report from LLMs. In the first example, an LLM attempts to describe the process behind its own "creative" writing, and we argue this is not a valid example of introspection. In the second example, an LLM correctly infers the value of its own temperature parameter, and we argue that this can be legitimately considered a minimal example of introspection, albeit one that is (presumably) not accompanied by conscious experience.
format Preprint
id arxiv_https___arxiv_org_abs_2506_05068
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Does It Make Sense to Speak of Introspection in Large Language Models?
Comsa, Iulia M.
Shanahan, Murray
Computation and Language
Artificial Intelligence
Large language models (LLMs) exhibit compelling linguistic behaviour, and sometimes offer self-reports, that is to say statements about their own nature, inner workings, or behaviour. In humans, such reports are often attributed to a faculty of introspection and are typically linked to consciousness. This raises the question of how to interpret self-reports produced by LLMs, given their increasing linguistic fluency and cognitive capabilities. To what extent (if any) can the concept of introspection be meaningfully applied to LLMs? Here, we present and critique two examples of apparent introspective self-report from LLMs. In the first example, an LLM attempts to describe the process behind its own "creative" writing, and we argue this is not a valid example of introspection. In the second example, an LLM correctly infers the value of its own temperature parameter, and we argue that this can be legitimately considered a minimal example of introspection, albeit one that is (presumably) not accompanied by conscious experience.
title Does It Make Sense to Speak of Introspection in Large Language Models?
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2506.05068