Agentic AI Needs a Systems Theory

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Miehling, Erik, Ramamurthy, Karthikeyan Natesan, Varshney, Kush R., Riemer, Matthew, Bouneffouf, Djallel, Richards, John T., Dhurandhar, Amit, Daly, Elizabeth M., Hind, Michael, Sattigeri, Prasanna, Wei, Dennis, Rawat, Ambrish, Gajcin, Jasmina, Geyer, Werner
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910851782410240
author Miehling, Erik
Ramamurthy, Karthikeyan Natesan
Varshney, Kush R.
Riemer, Matthew
Bouneffouf, Djallel
Richards, John T.
Dhurandhar, Amit
Daly, Elizabeth M.
Hind, Michael
Sattigeri, Prasanna
Wei, Dennis
Rawat, Ambrish
Gajcin, Jasmina
Geyer, Werner
author_facet Miehling, Erik
Ramamurthy, Karthikeyan Natesan
Varshney, Kush R.
Riemer, Matthew
Bouneffouf, Djallel
Richards, John T.
Dhurandhar, Amit
Daly, Elizabeth M.
Hind, Michael
Sattigeri, Prasanna
Wei, Dennis
Rawat, Ambrish
Gajcin, Jasmina
Geyer, Werner
contents The endowment of AI with reasoning capabilities and some degree of agency is widely viewed as a path toward more capable and generalizable systems. Our position is that the current development of agentic AI requires a more holistic, systems-theoretic perspective in order to fully understand their capabilities and mitigate any emergent risks. The primary motivation for our position is that AI development is currently overly focused on individual model capabilities, often ignoring broader emergent behavior, leading to a significant underestimation in the true capabilities and associated risks of agentic AI. We describe some fundamental mechanisms by which advanced capabilities can emerge from (comparably simpler) agents simply due to their interaction with the environment and other agents. Informed by an extensive amount of existing literature from various fields, we outline mechanisms for enhanced agent cognition, emergent causal reasoning ability, and metacognitive awareness. We conclude by presenting some key open challenges and guidance for the development of agentic AI. We emphasize that a systems-level perspective is essential for better understanding, and purposefully shaping, agentic AI systems.
format Preprint
id arxiv_https___arxiv_org_abs_2503_00237
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Agentic AI Needs a Systems Theory
Miehling, Erik
Ramamurthy, Karthikeyan Natesan
Varshney, Kush R.
Riemer, Matthew
Bouneffouf, Djallel
Richards, John T.
Dhurandhar, Amit
Daly, Elizabeth M.
Hind, Michael
Sattigeri, Prasanna
Wei, Dennis
Rawat, Ambrish
Gajcin, Jasmina
Geyer, Werner
Artificial Intelligence
The endowment of AI with reasoning capabilities and some degree of agency is widely viewed as a path toward more capable and generalizable systems. Our position is that the current development of agentic AI requires a more holistic, systems-theoretic perspective in order to fully understand their capabilities and mitigate any emergent risks. The primary motivation for our position is that AI development is currently overly focused on individual model capabilities, often ignoring broader emergent behavior, leading to a significant underestimation in the true capabilities and associated risks of agentic AI. We describe some fundamental mechanisms by which advanced capabilities can emerge from (comparably simpler) agents simply due to their interaction with the environment and other agents. Informed by an extensive amount of existing literature from various fields, we outline mechanisms for enhanced agent cognition, emergent causal reasoning ability, and metacognitive awareness. We conclude by presenting some key open challenges and guidance for the development of agentic AI. We emphasize that a systems-level perspective is essential for better understanding, and purposefully shaping, agentic AI systems.
title Agentic AI Needs a Systems Theory
topic Artificial Intelligence
url https://arxiv.org/abs/2503.00237