_version_ 1866917827124920320
author Rosbach, Emely
Ammeling, Jonas
Krügel, Sebastian
Kießig, Angelika
Fritz, Alexis
Ganz, Jonathan
Puget, Chloé
Donovan, Taryn
Klang, Andrea
Köller, Maximilian C.
Bolfa, Pompei
Tecilla, Marco
Denk, Daniela
Kiupel, Matti
Paraschou, Georgios
Kok, Mun Keong
Haake, Alexander F. H.
de Krijger, Ronald R.
Sonnen, Andreas F. -P.
Kasantikul, Tanit
Dorrestein, Gerry M.
Smedley, Rebecca C.
Stathonikos, Nikolas
Uhl, Matthias
Bertram, Christof A.
Riener, Andreas
Aubreville, Marc
author_facet Rosbach, Emely
Ammeling, Jonas
Krügel, Sebastian
Kießig, Angelika
Fritz, Alexis
Ganz, Jonathan
Puget, Chloé
Donovan, Taryn
Klang, Andrea
Köller, Maximilian C.
Bolfa, Pompei
Tecilla, Marco
Denk, Daniela
Kiupel, Matti
Paraschou, Georgios
Kok, Mun Keong
Haake, Alexander F. H.
de Krijger, Ronald R.
Sonnen, Andreas F. -P.
Kasantikul, Tanit
Dorrestein, Gerry M.
Smedley, Rebecca C.
Stathonikos, Nikolas
Uhl, Matthias
Bertram, Christof A.
Riener, Andreas
Aubreville, Marc
contents Artificial intelligence (AI)-based decision support systems hold promise for enhancing diagnostic accuracy and efficiency in computational pathology. However, human-AI collaboration can introduce and amplify cognitive biases, such as confirmation bias caused by false confirmation when erroneous human opinions are reinforced by inaccurate AI output. This bias may worsen when time pressure, ubiquitously present in routine pathology, strains practitioners' cognitive resources. We quantified confirmation bias triggered by AI-induced false confirmation and examined the role of time constraints in a web-based experiment, where trained pathology experts (n=28) estimated tumor cell percentages. Our results suggest that AI integration may fuel confirmation bias, evidenced by a statistically significant positive linear-mixed-effects model coefficient linking AI recommendations mirroring flawed human judgment and alignment with system advice. Conversely, time pressure appeared to weaken this relationship. These findings highlight potential risks of AI use in healthcare and aim to support the safe integration of clinical decision support systems.
format Preprint
id arxiv_https___arxiv_org_abs_2411_01007
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle When Two Wrongs Don't Make a Right" -- Examining Confirmation Bias and the Role of Time Pressure During Human-AI Collaboration in Computational Pathology
Rosbach, Emely
Ammeling, Jonas
Krügel, Sebastian
Kießig, Angelika
Fritz, Alexis
Ganz, Jonathan
Puget, Chloé
Donovan, Taryn
Klang, Andrea
Köller, Maximilian C.
Bolfa, Pompei
Tecilla, Marco
Denk, Daniela
Kiupel, Matti
Paraschou, Georgios
Kok, Mun Keong
Haake, Alexander F. H.
de Krijger, Ronald R.
Sonnen, Andreas F. -P.
Kasantikul, Tanit
Dorrestein, Gerry M.
Smedley, Rebecca C.
Stathonikos, Nikolas
Uhl, Matthias
Bertram, Christof A.
Riener, Andreas
Aubreville, Marc
Human-Computer Interaction
Artificial intelligence (AI)-based decision support systems hold promise for enhancing diagnostic accuracy and efficiency in computational pathology. However, human-AI collaboration can introduce and amplify cognitive biases, such as confirmation bias caused by false confirmation when erroneous human opinions are reinforced by inaccurate AI output. This bias may worsen when time pressure, ubiquitously present in routine pathology, strains practitioners' cognitive resources. We quantified confirmation bias triggered by AI-induced false confirmation and examined the role of time constraints in a web-based experiment, where trained pathology experts (n=28) estimated tumor cell percentages. Our results suggest that AI integration may fuel confirmation bias, evidenced by a statistically significant positive linear-mixed-effects model coefficient linking AI recommendations mirroring flawed human judgment and alignment with system advice. Conversely, time pressure appeared to weaken this relationship. These findings highlight potential risks of AI use in healthcare and aim to support the safe integration of clinical decision support systems.
title When Two Wrongs Don't Make a Right" -- Examining Confirmation Bias and the Role of Time Pressure During Human-AI Collaboration in Computational Pathology
topic Human-Computer Interaction
url https://arxiv.org/abs/2411.01007