Generalist Virtual Agents: A Survey on Autonomous Agents Across Digital Platforms

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Gao, Minghe, Bu, Wendong, Miao, Bingchen, Wu, Yang, Li, Yunfei, Li, Juncheng, Tang, Siliang, Wu, Qi, Zhuang, Yueting, Wang, Meng
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866929594770128896
author Gao, Minghe
Bu, Wendong
Miao, Bingchen
Wu, Yang
Li, Yunfei
Li, Juncheng
Tang, Siliang
Wu, Qi
Zhuang, Yueting
Wang, Meng
author_facet Gao, Minghe
Bu, Wendong
Miao, Bingchen
Wu, Yang
Li, Yunfei
Li, Juncheng
Tang, Siliang
Wu, Qi
Zhuang, Yueting
Wang, Meng
contents In this paper, we introduce the Generalist Virtual Agent (GVA), an autonomous entity engineered to function across diverse digital platforms and environments, assisting users by executing a variety of tasks. This survey delves into the evolution of GVAs, tracing their progress from early intelligent assistants to contemporary implementations that incorporate large-scale models. We explore both the philosophical underpinnings and practical foundations of GVAs, addressing their developmental challenges and the methodologies currently employed in their design and operation. By presenting a detailed taxonomy of GVA environments, tasks, and capabilities, this paper aims to bridge the theoretical and practical aspects of GVAs, concluding those that operate in environments closely mirroring the real world are more likely to demonstrate human-like intelligence. We discuss potential future directions for GVA research, highlighting the necessity for realistic evaluation metrics and the enhancement of long-sequence decision-making capabilities to advance the field toward more systematic or embodied applications. This work not only synthesizes the existing body of literature but also proposes frameworks for future investigations, contributing significantly to the ongoing development of intelligent systems.
format Preprint
id arxiv_https___arxiv_org_abs_2411_10943
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Generalist Virtual Agents: A Survey on Autonomous Agents Across Digital Platforms
Gao, Minghe
Bu, Wendong
Miao, Bingchen
Wu, Yang
Li, Yunfei
Li, Juncheng
Tang, Siliang
Wu, Qi
Zhuang, Yueting
Wang, Meng
Multiagent Systems
In this paper, we introduce the Generalist Virtual Agent (GVA), an autonomous entity engineered to function across diverse digital platforms and environments, assisting users by executing a variety of tasks. This survey delves into the evolution of GVAs, tracing their progress from early intelligent assistants to contemporary implementations that incorporate large-scale models. We explore both the philosophical underpinnings and practical foundations of GVAs, addressing their developmental challenges and the methodologies currently employed in their design and operation. By presenting a detailed taxonomy of GVA environments, tasks, and capabilities, this paper aims to bridge the theoretical and practical aspects of GVAs, concluding those that operate in environments closely mirroring the real world are more likely to demonstrate human-like intelligence. We discuss potential future directions for GVA research, highlighting the necessity for realistic evaluation metrics and the enhancement of long-sequence decision-making capabilities to advance the field toward more systematic or embodied applications. This work not only synthesizes the existing body of literature but also proposes frameworks for future investigations, contributing significantly to the ongoing development of intelligent systems.
title Generalist Virtual Agents: A Survey on Autonomous Agents Across Digital Platforms
topic Multiagent Systems
url https://arxiv.org/abs/2411.10943