Saved in:
Bibliographic Details
Main Authors: Cun, Xi, Ren, Jifan, Huang, Asha, Li, Siyu, Song, Ruzhen
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2511.22151
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914172578562048
author Cun, Xi
Ren, Jifan
Huang, Asha
Li, Siyu
Song, Ruzhen
author_facet Cun, Xi
Ren, Jifan
Huang, Asha
Li, Siyu
Song, Ruzhen
contents Can machines think? This is a central question in artificial intelligence research. However, there is a substantial divergence of views on the answer to this question. Why do people have such significant differences of opinion, even when they are observing the same real world performance of artificial intelligence? The ability of logical reasoning like humans is often used as a criterion to assess whether a machine can think. This study explores whether human biases influence evaluations of the reasoning abilities of AI. An experiment was conducted where participants assessed two texts on the same topic, one AI generated and one human written,to test for perceptual biases in evaluating logical reasoning. Based on the experimental findings, a questionnaire was designed to quantify the attitudes toward AI.The results reveal a bias in perception. The evaluations of the logical reasoning ability of AI generated texts are significantly influenced by the preconceived views on the logical reasoning abilities of AI. Furthermore, frequent AI users were less likely to believe that AI usage undermines independent thinking.This study highlights the need to address perceptual biases to improve public understanding of AI's capabilities and foster better human AI interactions.
format Preprint
id arxiv_https___arxiv_org_abs_2511_22151
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A perceptual bias of AI Logical Argumentation Ability in Writing
Cun, Xi
Ren, Jifan
Huang, Asha
Li, Siyu
Song, Ruzhen
Artificial Intelligence
Can machines think? This is a central question in artificial intelligence research. However, there is a substantial divergence of views on the answer to this question. Why do people have such significant differences of opinion, even when they are observing the same real world performance of artificial intelligence? The ability of logical reasoning like humans is often used as a criterion to assess whether a machine can think. This study explores whether human biases influence evaluations of the reasoning abilities of AI. An experiment was conducted where participants assessed two texts on the same topic, one AI generated and one human written,to test for perceptual biases in evaluating logical reasoning. Based on the experimental findings, a questionnaire was designed to quantify the attitudes toward AI.The results reveal a bias in perception. The evaluations of the logical reasoning ability of AI generated texts are significantly influenced by the preconceived views on the logical reasoning abilities of AI. Furthermore, frequent AI users were less likely to believe that AI usage undermines independent thinking.This study highlights the need to address perceptual biases to improve public understanding of AI's capabilities and foster better human AI interactions.
title A perceptual bias of AI Logical Argumentation Ability in Writing
topic Artificial Intelligence
url https://arxiv.org/abs/2511.22151