CAUS: A Dataset for Question Generation based on Human Cognition Leveraging Large Language Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shin, Minjung, Kim, Donghyun, Ryu, Jeh-Kwang
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916251031306240
author Shin, Minjung
Kim, Donghyun
Ryu, Jeh-Kwang
author_facet Shin, Minjung
Kim, Donghyun
Ryu, Jeh-Kwang
contents We introduce the Curious About Uncertain Scene (CAUS) dataset, designed to enable Large Language Models, specifically GPT-4, to emulate human cognitive processes for resolving uncertainties. Leveraging this dataset, we investigate the potential of LLMs to engage in questioning effectively. Our approach involves providing scene descriptions embedded with uncertainties to stimulate the generation of reasoning and queries. The queries are then classified according to multi-dimensional criteria. All procedures are facilitated by a collaborative system involving both LLMs and human researchers. Our results demonstrate that GPT-4 can effectively generate pertinent questions and grasp their nuances, particularly when given appropriate context and instructions. The study suggests that incorporating human-like questioning into AI models improves their ability to manage uncertainties, paving the way for future advancements in Artificial Intelligence (AI).
format Preprint
id arxiv_https___arxiv_org_abs_2404_11835
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle CAUS: A Dataset for Question Generation based on Human Cognition Leveraging Large Language Models
Shin, Minjung
Kim, Donghyun
Ryu, Jeh-Kwang
Artificial Intelligence
We introduce the Curious About Uncertain Scene (CAUS) dataset, designed to enable Large Language Models, specifically GPT-4, to emulate human cognitive processes for resolving uncertainties. Leveraging this dataset, we investigate the potential of LLMs to engage in questioning effectively. Our approach involves providing scene descriptions embedded with uncertainties to stimulate the generation of reasoning and queries. The queries are then classified according to multi-dimensional criteria. All procedures are facilitated by a collaborative system involving both LLMs and human researchers. Our results demonstrate that GPT-4 can effectively generate pertinent questions and grasp their nuances, particularly when given appropriate context and instructions. The study suggests that incorporating human-like questioning into AI models improves their ability to manage uncertainties, paving the way for future advancements in Artificial Intelligence (AI).
title CAUS: A Dataset for Question Generation based on Human Cognition Leveraging Large Language Models
topic Artificial Intelligence
url https://arxiv.org/abs/2404.11835