Validation and Comparison of Non-Stationary Cognitive Models: A Diffusion Model Application

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Schumacher, Lukas, Schnuerch, Martin, Voss, Andreas, Radev, Stefan T.
Format: Preprint
Veröffentlicht: 2023
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866908066233974784
author Schumacher, Lukas
Schnuerch, Martin
Voss, Andreas
Radev, Stefan T.
author_facet Schumacher, Lukas
Schnuerch, Martin
Voss, Andreas
Radev, Stefan T.
contents Cognitive processes undergo various fluctuations and transient states across different temporal scales. Superstatistics are emerging as a flexible framework for incorporating such non-stationary dynamics into existing cognitive model classes. In this work, we provide the first experimental validation of superstatistics and formal comparison of four non-stationary diffusion decision models in a specifically designed perceptual decision-making task. Task difficulty and speed-accuracy trade-off were systematically manipulated to induce expected changes in model parameters. To validate our models, we assess whether the inferred parameter trajectories align with the patterns and sequences of the experimental manipulations. To address computational challenges, we present novel deep learning techniques for amortized Bayesian estimation and comparison of models with time-varying parameters. Our findings indicate that transition models incorporating both gradual and abrupt parameter shifts provide the best fit to the empirical data. Moreover, we find that the inferred parameter trajectories closely mirror the sequence of experimental manipulations. Posterior re-simulations further underscore the ability of the models to faithfully reproduce critical data patterns. Accordingly, our results suggest that the inferred non-stationary dynamics may reflect actual changes in the targeted psychological constructs. We argue that our initial experimental validation paves the way for the widespread application of superstatistics in cognitive modeling and beyond.
format Preprint
id arxiv_https___arxiv_org_abs_2401_08626
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Validation and Comparison of Non-Stationary Cognitive Models: A Diffusion Model Application
Schumacher, Lukas
Schnuerch, Martin
Voss, Andreas
Radev, Stefan T.
Neurons and Cognition
Methodology
Cognitive processes undergo various fluctuations and transient states across different temporal scales. Superstatistics are emerging as a flexible framework for incorporating such non-stationary dynamics into existing cognitive model classes. In this work, we provide the first experimental validation of superstatistics and formal comparison of four non-stationary diffusion decision models in a specifically designed perceptual decision-making task. Task difficulty and speed-accuracy trade-off were systematically manipulated to induce expected changes in model parameters. To validate our models, we assess whether the inferred parameter trajectories align with the patterns and sequences of the experimental manipulations. To address computational challenges, we present novel deep learning techniques for amortized Bayesian estimation and comparison of models with time-varying parameters. Our findings indicate that transition models incorporating both gradual and abrupt parameter shifts provide the best fit to the empirical data. Moreover, we find that the inferred parameter trajectories closely mirror the sequence of experimental manipulations. Posterior re-simulations further underscore the ability of the models to faithfully reproduce critical data patterns. Accordingly, our results suggest that the inferred non-stationary dynamics may reflect actual changes in the targeted psychological constructs. We argue that our initial experimental validation paves the way for the widespread application of superstatistics in cognitive modeling and beyond.
title Validation and Comparison of Non-Stationary Cognitive Models: A Diffusion Model Application
topic Neurons and Cognition
Methodology
url https://arxiv.org/abs/2401.08626