Beyond Recommendations: From Backward to Forward AI Support of Pilots' Decision-Making Process

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Zelun Tony, Feger, Sebastian S., Dullenkopf, Lucas, Liao, Rulu, Süsslin, Lukas, Liu, Yuanting, Butz, Andreas
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914953197256704
author Zhang, Zelun Tony
Feger, Sebastian S.
Dullenkopf, Lucas
Liao, Rulu
Süsslin, Lukas
Liu, Yuanting
Butz, Andreas
author_facet Zhang, Zelun Tony
Feger, Sebastian S.
Dullenkopf, Lucas
Liao, Rulu
Süsslin, Lukas
Liu, Yuanting
Butz, Andreas
contents AI is anticipated to enhance human decision-making in high-stakes domains like aviation, but adoption is often hindered by challenges such as inappropriate reliance and poor alignment with users' decision-making. Recent research suggests that a core underlying issue is the recommendation-centric design of many AI systems, i.e., they give end-to-end recommendations and ignore the rest of the decision-making process. Alternative support paradigms are rare, and it remains unclear how the few that do exist compare to recommendation-centric support. In this work, we aimed to empirically compare recommendation-centric support to an alternative paradigm, continuous support, in the context of diversions in aviation. We conducted a mixed-methods study with 32 professional pilots in a realistic setting. To ensure the quality of our study scenarios, we conducted a focus group with four additional pilots prior to the study. We found that continuous support can support pilots' decision-making in a forward direction, allowing them to think more beyond the limits of the system and make faster decisions when combined with recommendations, though the forward support can be disrupted. Participants' statements further suggest a shift in design goal away from providing recommendations, to supporting quick information gathering. Our results show ways to design more helpful and effective AI decision support that goes beyond end-to-end recommendations.
format Preprint
id arxiv_https___arxiv_org_abs_2406_08959
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Beyond Recommendations: From Backward to Forward AI Support of Pilots' Decision-Making Process
Zhang, Zelun Tony
Feger, Sebastian S.
Dullenkopf, Lucas
Liao, Rulu
Süsslin, Lukas
Liu, Yuanting
Butz, Andreas
Human-Computer Interaction
Artificial Intelligence
AI is anticipated to enhance human decision-making in high-stakes domains like aviation, but adoption is often hindered by challenges such as inappropriate reliance and poor alignment with users' decision-making. Recent research suggests that a core underlying issue is the recommendation-centric design of many AI systems, i.e., they give end-to-end recommendations and ignore the rest of the decision-making process. Alternative support paradigms are rare, and it remains unclear how the few that do exist compare to recommendation-centric support. In this work, we aimed to empirically compare recommendation-centric support to an alternative paradigm, continuous support, in the context of diversions in aviation. We conducted a mixed-methods study with 32 professional pilots in a realistic setting. To ensure the quality of our study scenarios, we conducted a focus group with four additional pilots prior to the study. We found that continuous support can support pilots' decision-making in a forward direction, allowing them to think more beyond the limits of the system and make faster decisions when combined with recommendations, though the forward support can be disrupted. Participants' statements further suggest a shift in design goal away from providing recommendations, to supporting quick information gathering. Our results show ways to design more helpful and effective AI decision support that goes beyond end-to-end recommendations.
title Beyond Recommendations: From Backward to Forward AI Support of Pilots' Decision-Making Process
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2406.08959