AndroidGen: Building an Android Language Agent under Data Scarcity

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lai, Hanyu, Gao, Junjie, Liu, Xiao, Xu, Yifan, Zhang, Shudan, Dong, Yuxiao, Tang, Jie
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918001622646784
author Lai, Hanyu
Gao, Junjie
Liu, Xiao
Xu, Yifan
Zhang, Shudan
Dong, Yuxiao
Tang, Jie
author_facet Lai, Hanyu
Gao, Junjie
Liu, Xiao
Xu, Yifan
Zhang, Shudan
Dong, Yuxiao
Tang, Jie
contents Large language models have opened up a world of possibilities for various NLP tasks, sparking optimism for the future. Despite their potential, LLMs have yet to be widely used as agents on real mobile devices. The main challenge is the need for high-quality data sources. Time constraints and labor intensity often hinder human annotation. On the other hand, existing LLMs exhibit inadequate completion rates and need a robust data filtration strategy. Given these challenges, we develop a framework called AndroidGen to enhance the capabilities of LLM-based agents under data scarcity. In addition, we leverage AndroidGen to collect trajectories given human tasks and train open-source LLMs on these trajectories to develop an open-source mobile agent without manually labeled trajectories. We extensively evaluate AndroidGen with AndroidWorld, AitW, and various popular applications, demonstrating its improvements and revealing potential areas for future improvement. Code, model, and data are available at https://github.com/THUDM/AndroidGen.
format Preprint
id arxiv_https___arxiv_org_abs_2504_19298
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle AndroidGen: Building an Android Language Agent under Data Scarcity
Lai, Hanyu
Gao, Junjie
Liu, Xiao
Xu, Yifan
Zhang, Shudan
Dong, Yuxiao
Tang, Jie
Computation and Language
Large language models have opened up a world of possibilities for various NLP tasks, sparking optimism for the future. Despite their potential, LLMs have yet to be widely used as agents on real mobile devices. The main challenge is the need for high-quality data sources. Time constraints and labor intensity often hinder human annotation. On the other hand, existing LLMs exhibit inadequate completion rates and need a robust data filtration strategy. Given these challenges, we develop a framework called AndroidGen to enhance the capabilities of LLM-based agents under data scarcity. In addition, we leverage AndroidGen to collect trajectories given human tasks and train open-source LLMs on these trajectories to develop an open-source mobile agent without manually labeled trajectories. We extensively evaluate AndroidGen with AndroidWorld, AitW, and various popular applications, demonstrating its improvements and revealing potential areas for future improvement. Code, model, and data are available at https://github.com/THUDM/AndroidGen.
title AndroidGen: Building an Android Language Agent under Data Scarcity
topic Computation and Language
url https://arxiv.org/abs/2504.19298