Saved in:
Bibliographic Details
Main Authors: He, Kaichen, Wang, Zihao, Li, Muyao, Liu, Anji, Liang, Yitao
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2512.09706
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917137042374656
author He, Kaichen
Wang, Zihao
Li, Muyao
Liu, Anji
Liang, Yitao
author_facet He, Kaichen
Wang, Zihao
Li, Muyao
Liu, Anji
Liang, Yitao
contents The paradigm of agentic AI is shifting from engineered complex workflows to post-training native models. However, existing agents are typically confined to static, predefined action spaces--such as exclusively using APIs, GUI events, or robotic commands. This rigidity limits their adaptability in dynamic environments where the optimal granularity of interaction varies contextually. To bridge this gap, we propose CrossAgent, a unified agentic model that masters heterogeneous action spaces and autonomously selects the most effective interface for each step of a trajectory. We introduce a comprehensive training pipeline that integrates cold-start supervised fine-tuning with a Multi-Turn Group Relative Policy Optimization (GRPO) algorithm. This approach enables the agent to learn adaptive action switching--balancing high-level efficiency with low-level precision--without human-specified rules. Extensive experiments on over 800 tasks in the open-world Minecraft environment demonstrate that CrossAgent achieves state-of-the-art performance. By dynamically leveraging the strengths of diverse action spaces, our model significantly outperforms fixed-action baselines, exhibiting superior generalization and efficiency in long-horizon reasoning. All code and models are available at https://github.com/CraftJarvis/OpenHA
format Preprint
id arxiv_https___arxiv_org_abs_2512_09706
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Training One Model to Master Cross-Level Agentic Actions via Reinforcement Learning
He, Kaichen
Wang, Zihao
Li, Muyao
Liu, Anji
Liang, Yitao
Machine Learning
The paradigm of agentic AI is shifting from engineered complex workflows to post-training native models. However, existing agents are typically confined to static, predefined action spaces--such as exclusively using APIs, GUI events, or robotic commands. This rigidity limits their adaptability in dynamic environments where the optimal granularity of interaction varies contextually. To bridge this gap, we propose CrossAgent, a unified agentic model that masters heterogeneous action spaces and autonomously selects the most effective interface for each step of a trajectory. We introduce a comprehensive training pipeline that integrates cold-start supervised fine-tuning with a Multi-Turn Group Relative Policy Optimization (GRPO) algorithm. This approach enables the agent to learn adaptive action switching--balancing high-level efficiency with low-level precision--without human-specified rules. Extensive experiments on over 800 tasks in the open-world Minecraft environment demonstrate that CrossAgent achieves state-of-the-art performance. By dynamically leveraging the strengths of diverse action spaces, our model significantly outperforms fixed-action baselines, exhibiting superior generalization and efficiency in long-horizon reasoning. All code and models are available at https://github.com/CraftJarvis/OpenHA
title Training One Model to Master Cross-Level Agentic Actions via Reinforcement Learning
topic Machine Learning
url https://arxiv.org/abs/2512.09706