Language Models as Critical Thinking Tools: A Case Study of Philosophers

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ye, Andre, Moore, Jared, Novick, Rose, Zhang, Amy X.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913461070462976
author Ye, Andre
Moore, Jared
Novick, Rose
Zhang, Amy X.
author_facet Ye, Andre
Moore, Jared
Novick, Rose
Zhang, Amy X.
contents Current work in language models (LMs) helps us speed up or even skip thinking by accelerating and automating cognitive work. But can LMs help us with critical thinking -- thinking in deeper, more reflective ways which challenge assumptions, clarify ideas, and engineer new concepts? We treat philosophy as a case study in critical thinking, and interview 21 professional philosophers about how they engage in critical thinking and on their experiences with LMs. We find that philosophers do not find LMs to be useful because they lack a sense of selfhood (memory, beliefs, consistency) and initiative (curiosity, proactivity). We propose the selfhood-initiative model for critical thinking tools to characterize this gap. Using the model, we formulate three roles LMs could play as critical thinking tools: the Interlocutor, the Monitor, and the Respondent. We hope that our work inspires LM researchers to further develop LMs as critical thinking tools and philosophers and other 'critical thinkers' to imagine intellectually substantive uses of LMs.
format Preprint
id arxiv_https___arxiv_org_abs_2404_04516
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Language Models as Critical Thinking Tools: A Case Study of Philosophers
Ye, Andre
Moore, Jared
Novick, Rose
Zhang, Amy X.
Human-Computer Interaction
Computation and Language
Computers and Society
Current work in language models (LMs) helps us speed up or even skip thinking by accelerating and automating cognitive work. But can LMs help us with critical thinking -- thinking in deeper, more reflective ways which challenge assumptions, clarify ideas, and engineer new concepts? We treat philosophy as a case study in critical thinking, and interview 21 professional philosophers about how they engage in critical thinking and on their experiences with LMs. We find that philosophers do not find LMs to be useful because they lack a sense of selfhood (memory, beliefs, consistency) and initiative (curiosity, proactivity). We propose the selfhood-initiative model for critical thinking tools to characterize this gap. Using the model, we formulate three roles LMs could play as critical thinking tools: the Interlocutor, the Monitor, and the Respondent. We hope that our work inspires LM researchers to further develop LMs as critical thinking tools and philosophers and other 'critical thinkers' to imagine intellectually substantive uses of LMs.
title Language Models as Critical Thinking Tools: A Case Study of Philosophers
topic Human-Computer Interaction
Computation and Language
Computers and Society
url https://arxiv.org/abs/2404.04516