CogniDual Framework: Self-Training Large Language Models within a Dual-System Theoretical Framework for Improving Cognitive Tasks

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Deng, Yongxin, Qiu, Xihe, Tan, Xiaoyu, Qu, Chao, Pan, Jing, Cheng, Yuan, Xu, Yinghui, Chu, Wei
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912017184456704
author Deng, Yongxin
Qiu, Xihe
Tan, Xiaoyu
Qu, Chao
Pan, Jing
Cheng, Yuan
Xu, Yinghui
Chu, Wei
author_facet Deng, Yongxin
Qiu, Xihe
Tan, Xiaoyu
Qu, Chao
Pan, Jing
Cheng, Yuan
Xu, Yinghui
Chu, Wei
contents Cognitive psychology investigates perception, attention, memory, language, problem-solving, decision-making, and reasoning. Kahneman's dual-system theory elucidates the human decision-making process, distinguishing between the rapid, intuitive System 1 and the deliberative, rational System 2. Recent advancements have positioned large language Models (LLMs) as formidable tools nearing human-level proficiency in various cognitive tasks. Nonetheless, the presence of a dual-system framework analogous to human cognition in LLMs remains unexplored. This study introduces the \textbf{CogniDual Framework for LLMs} (CFLLMs), designed to assess whether LLMs can, through self-training, evolve from deliberate deduction to intuitive responses, thereby emulating the human process of acquiring and mastering new information. Our findings reveal the cognitive mechanisms behind LLMs' response generation, enhancing our understanding of their capabilities in cognitive psychology. Practically, self-trained models can provide faster responses to certain queries, reducing computational demands during inference.
format Preprint
id arxiv_https___arxiv_org_abs_2409_03381
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle CogniDual Framework: Self-Training Large Language Models within a Dual-System Theoretical Framework for Improving Cognitive Tasks
Deng, Yongxin
Qiu, Xihe
Tan, Xiaoyu
Qu, Chao
Pan, Jing
Cheng, Yuan
Xu, Yinghui
Chu, Wei
Computation and Language
Artificial Intelligence
Cognitive psychology investigates perception, attention, memory, language, problem-solving, decision-making, and reasoning. Kahneman's dual-system theory elucidates the human decision-making process, distinguishing between the rapid, intuitive System 1 and the deliberative, rational System 2. Recent advancements have positioned large language Models (LLMs) as formidable tools nearing human-level proficiency in various cognitive tasks. Nonetheless, the presence of a dual-system framework analogous to human cognition in LLMs remains unexplored. This study introduces the \textbf{CogniDual Framework for LLMs} (CFLLMs), designed to assess whether LLMs can, through self-training, evolve from deliberate deduction to intuitive responses, thereby emulating the human process of acquiring and mastering new information. Our findings reveal the cognitive mechanisms behind LLMs' response generation, enhancing our understanding of their capabilities in cognitive psychology. Practically, self-trained models can provide faster responses to certain queries, reducing computational demands during inference.
title CogniDual Framework: Self-Training Large Language Models within a Dual-System Theoretical Framework for Improving Cognitive Tasks
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2409.03381