Can we automatize scientific discovery in the cognitive sciences?

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Jagadish, Akshay K., Rmus, Milena, Witte, Kristin, Mathony, Marvin, Binz, Marcel, Schulz, Eric
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910062750990336
author Jagadish, Akshay K.
Rmus, Milena
Witte, Kristin
Mathony, Marvin
Binz, Marcel
Schulz, Eric
author_facet Jagadish, Akshay K.
Rmus, Milena
Witte, Kristin
Mathony, Marvin
Binz, Marcel
Schulz, Eric
contents The cognitive sciences aim to understand intelligence by formalizing underlying operations as computational models. Traditionally, this follows a cycle of discovery where researchers develop paradigms, collect data, and test predefined model classes. However, this manual pipeline is fundamentally constrained by the slow pace of human intervention and a search space limited by researchers' background and intuition. Here, we propose a paradigm shift toward a fully automated, in silico science of the mind that implements every stage of the discovery cycle using Large Language Models (LLMs). In this framework, experimental paradigms exploring conceptually meaningful task structures are directly sampled from an LLM. High-fidelity behavioral data are then simulated using foundation models of cognition. The tedious step of handcrafting cognitive models is replaced by LLM-based program synthesis, which performs a high-throughput search over a vast landscape of algorithmic hypotheses. Finally, the discovery loop is closed by optimizing for ''interestingness'', a metric of conceptual yield evaluated by an LLM-critic. By enabling a fast and scalable approach to theory development, this automated loop functions as a high-throughput in-silico discovery engine, surfacing informative experiments and mechanisms for subsequent validation in real human populations.
format Preprint
id arxiv_https___arxiv_org_abs_2603_20988
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Can we automatize scientific discovery in the cognitive sciences?
Jagadish, Akshay K.
Rmus, Milena
Witte, Kristin
Mathony, Marvin
Binz, Marcel
Schulz, Eric
Artificial Intelligence
Neurons and Cognition
The cognitive sciences aim to understand intelligence by formalizing underlying operations as computational models. Traditionally, this follows a cycle of discovery where researchers develop paradigms, collect data, and test predefined model classes. However, this manual pipeline is fundamentally constrained by the slow pace of human intervention and a search space limited by researchers' background and intuition. Here, we propose a paradigm shift toward a fully automated, in silico science of the mind that implements every stage of the discovery cycle using Large Language Models (LLMs). In this framework, experimental paradigms exploring conceptually meaningful task structures are directly sampled from an LLM. High-fidelity behavioral data are then simulated using foundation models of cognition. The tedious step of handcrafting cognitive models is replaced by LLM-based program synthesis, which performs a high-throughput search over a vast landscape of algorithmic hypotheses. Finally, the discovery loop is closed by optimizing for ''interestingness'', a metric of conceptual yield evaluated by an LLM-critic. By enabling a fast and scalable approach to theory development, this automated loop functions as a high-throughput in-silico discovery engine, surfacing informative experiments and mechanisms for subsequent validation in real human populations.
title Can we automatize scientific discovery in the cognitive sciences?
topic Artificial Intelligence
Neurons and Cognition
url https://arxiv.org/abs/2603.20988