Quriosity: Analyzing Human Questioning Behavior and Causal Inquiry through Curiosity-Driven Queries
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918191198896128 |
|---|---|
| author | Ceraolo, Roberto Kharlapenko, Dmitrii Khan, Ahmad Reymond, Amélie Pandey, Punya Syon Mihalcea, Rada Schölkopf, Bernhard Sachan, Mrinmaya Jin, Zhijing |
| author_facet | Ceraolo, Roberto Kharlapenko, Dmitrii Khan, Ahmad Reymond, Amélie Pandey, Punya Syon Mihalcea, Rada Schölkopf, Bernhard Sachan, Mrinmaya Jin, Zhijing |
| contents | Recent progress in Large Language Model (LLM) technology has changed our role in interacting with these models. Instead of primarily testing these models with questions we already know answers to, we are now using them for queries where the answers are unknown to us, driven by human curiosity. This shift highlights the growing need to understand curiosity-driven human questions - those that are more complex, open-ended, and reflective of real-world needs. To this end, we present Quriosity, a collection of 13.5K naturally occurring questions from three diverse sources: human-to-search-engine queries, human-to-human interactions, and human-to-LLM conversations. Our comprehensive collection enables a rich understanding of human curiosity across various domains and contexts. Our analysis reveals a significant presence of causal questions (up to 42%) in the dataset, for which we develop an iterative prompt improvement framework to identify all causal queries and examine their unique linguistic properties, cognitive complexity and source distribution. Our paper paves the way for future work on causal question identification and open-ended chatbot interactions. Our code and data are at https://github.com/roberto-ceraolo/quriosity. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_20318 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Quriosity: Analyzing Human Questioning Behavior and Causal Inquiry through Curiosity-Driven Queries Ceraolo, Roberto Kharlapenko, Dmitrii Khan, Ahmad Reymond, Amélie Pandey, Punya Syon Mihalcea, Rada Schölkopf, Bernhard Sachan, Mrinmaya Jin, Zhijing Computation and Language Artificial Intelligence Machine Learning Recent progress in Large Language Model (LLM) technology has changed our role in interacting with these models. Instead of primarily testing these models with questions we already know answers to, we are now using them for queries where the answers are unknown to us, driven by human curiosity. This shift highlights the growing need to understand curiosity-driven human questions - those that are more complex, open-ended, and reflective of real-world needs. To this end, we present Quriosity, a collection of 13.5K naturally occurring questions from three diverse sources: human-to-search-engine queries, human-to-human interactions, and human-to-LLM conversations. Our comprehensive collection enables a rich understanding of human curiosity across various domains and contexts. Our analysis reveals a significant presence of causal questions (up to 42%) in the dataset, for which we develop an iterative prompt improvement framework to identify all causal queries and examine their unique linguistic properties, cognitive complexity and source distribution. Our paper paves the way for future work on causal question identification and open-ended chatbot interactions. Our code and data are at https://github.com/roberto-ceraolo/quriosity. |
| title | Quriosity: Analyzing Human Questioning Behavior and Causal Inquiry through Curiosity-Driven Queries |
| topic | Computation and Language Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2405.20318 |