Fitting, Evaluating, and Comparing Cognitive Architecture Models Using Likelihood: A Primer With Examples in ACT-R

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Stocco, Andrea, Mitsopoulos, Konstantinos, Yang, Yuxue C., Hake, Holly S., Haile, Theodros, Leonard, Bridget, Gluck, Kevin
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929555763101696
author Stocco, Andrea
Mitsopoulos, Konstantinos
Yang, Yuxue C.
Hake, Holly S.
Haile, Theodros
Leonard, Bridget
Gluck, Kevin
author_facet Stocco, Andrea
Mitsopoulos, Konstantinos
Yang, Yuxue C.
Hake, Holly S.
Haile, Theodros
Leonard, Bridget
Gluck, Kevin
contents Cognitive architectures are influential, integrated computational frameworks for modeling cognitive processes. Due to a variety of factors, however, researchers using cognitive architectures to explain and predict human performance rarely employ model validation, comparison, and selection techniques based on likelihood. This paper provides a primer on how to implement maximum likelihood techniques and its derivatives to fit and compare models at the individual and group level, using models implemented in the ACT-R cognitive architecture as examples. The paper covers the most common ways in which likelihood measures can be applied, under different scenarios, for models of different complexity, and provides further technical references for the interested reader. An accompanying notebook in Python provides the code to implement all of the suggestions.
format Preprint
id arxiv_https___arxiv_org_abs_2410_18055
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Fitting, Evaluating, and Comparing Cognitive Architecture Models Using Likelihood: A Primer With Examples in ACT-R
Stocco, Andrea
Mitsopoulos, Konstantinos
Yang, Yuxue C.
Hake, Holly S.
Haile, Theodros
Leonard, Bridget
Gluck, Kevin
Neurons and Cognition
Cognitive architectures are influential, integrated computational frameworks for modeling cognitive processes. Due to a variety of factors, however, researchers using cognitive architectures to explain and predict human performance rarely employ model validation, comparison, and selection techniques based on likelihood. This paper provides a primer on how to implement maximum likelihood techniques and its derivatives to fit and compare models at the individual and group level, using models implemented in the ACT-R cognitive architecture as examples. The paper covers the most common ways in which likelihood measures can be applied, under different scenarios, for models of different complexity, and provides further technical references for the interested reader. An accompanying notebook in Python provides the code to implement all of the suggestions.
title Fitting, Evaluating, and Comparing Cognitive Architecture Models Using Likelihood: A Primer With Examples in ACT-R
topic Neurons and Cognition
url https://arxiv.org/abs/2410.18055