Architecting Human‐AI Systems for Effective Collaboration and Oversight: Making Sense of Human/AI‐in/on/Over/Under/Along‐the‐Loop

Fuente: Wiley Open Access
Salvato in:
Dettagli Bibliografici
Autori principali: Aditya Singh, Zoe Szajnfarber
Natura: Artículo Open Access
Pubblicazione: Wiley 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1867004301178568704
author Aditya Singh
Zoe Szajnfarber
author_facet Aditya Singh
Zoe Szajnfarber
Aditya Singh
Zoe Szajnfarber
collection Wiley Open Access
contents Architecting Human‐AI Systems for Effective Collaboration and Oversight: Making Sense of Human/AI‐in/on/Over/Under/Along‐the‐Loop Aditya Singh Zoe Szajnfarber Systems Engineering ABSTRACT Governments around the world have written policies mandating human control over AI to ensure systems being deployed are safe and trustworthy. The core ideas behind these policies are that human control can prevent AI from making mistakes and that human collaboration with AI can leverage the unique strengths of both to create superior human‐AI systems. While the goals of these policies are laudable, they lack adequate explanations of how exactly humans are meant to have control over, or partner with, AI. To address this gap, we present a comprehensive taxonomy of human‐AI system architectures derived from synthesizing decades of human‐machine, human‐computer, and human‐robot interaction literature. Our taxonomy clarifies the conceptual inconsistencies of human‐in/on/etc.‐the‐loop terminology by analyzing prior literature through a common conceptual understanding of architecture, which we define as task allocation and the relationship between humans and AI. We identify critical gaps in existing frameworks, which have focused primarily on AI decision aids and human supervision, while neglecting emerging architectures. We also describe a four step process to use the taxonomy. 10.1002/sys.70024 http://onlinelibrary.wiley.com/termsAndConditions#am
doi_str_mv 10.1002/sys.70024
format Artículo Open Access
id wiley_oa_10_1002_sys_70024
institution Wiley Open Access
license_str_mv http://onlinelibrary.wiley.com/termsAndConditions#am
publishDate 2025
publisher Wiley
record_format wiley_oa
spellingShingle Architecting Human‐AI Systems for Effective Collaboration and Oversight: Making Sense of Human/AI‐in/on/Over/Under/Along‐the‐Loop
Aditya Singh
Zoe Szajnfarber
Systems Engineering
Architecting Human‐AI Systems for Effective Collaboration and Oversight: Making Sense of Human/AI‐in/on/Over/Under/Along‐the‐Loop Aditya Singh Zoe Szajnfarber Systems Engineering ABSTRACT Governments around the world have written policies mandating human control over AI to ensure systems being deployed are safe and trustworthy. The core ideas behind these policies are that human control can prevent AI from making mistakes and that human collaboration with AI can leverage the unique strengths of both to create superior human‐AI systems. While the goals of these policies are laudable, they lack adequate explanations of how exactly humans are meant to have control over, or partner with, AI. To address this gap, we present a comprehensive taxonomy of human‐AI system architectures derived from synthesizing decades of human‐machine, human‐computer, and human‐robot interaction literature. Our taxonomy clarifies the conceptual inconsistencies of human‐in/on/etc.‐the‐loop terminology by analyzing prior literature through a common conceptual understanding of architecture, which we define as task allocation and the relationship between humans and AI. We identify critical gaps in existing frameworks, which have focused primarily on AI decision aids and human supervision, while neglecting emerging architectures. We also describe a four step process to use the taxonomy. 10.1002/sys.70024 http://onlinelibrary.wiley.com/termsAndConditions#am
title Architecting Human‐AI Systems for Effective Collaboration and Oversight: Making Sense of Human/AI‐in/on/Over/Under/Along‐the‐Loop
topic Systems Engineering
url https://incose.onlinelibrary.wiley.com/doi/10.1002/sys.70024