Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2602.22697 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915818436034560 |
|---|---|
| author | Gao, Ning Zhang, Wei Dai, Yuqin Shi, Ling Wang, Ziyin Wang, Yujie He, Wei Wang, Jinpeng Wang, Chaozheng |
| author_facet | Gao, Ning Zhang, Wei Dai, Yuqin Shi, Ling Wang, Ziyin Wang, Yujie He, Wei Wang, Jinpeng Wang, Chaozheng |
| contents | The rapid evolution of Large Language Models (LLMs) has accelerated the transition from conversational chatbots to general agents. However, effectively balancing empathetic communication with budget-aware decision-making remains an open challenge. Since existing methods fail to capture these complex strategic trade-offs, we propose InteractCS-RL, a framework that reframes task-oriented dialogue as a multi-granularity reinforcement learning process. Specifically, we first establish a User-centric Interaction Framework to provide a high-fidelity training gym, enabling agents to dynamically explore diverse strategies with persona-driven users. Then, we introduce Cost-aware Multi-turn Policy Optimization (CMPO) with a hybrid advantage estimation strategy. By integrating generative process credits and employing a PID-Lagrangian cost controller, CMPO effectively guides the policy to explore Pareto boundary between user reward and global cost constraints. Extensive experiments on customized real business scenarios demonstrate that InteractCS-RL significantly outperform other baselines across three evaluation dimensions. Further evaluation on tool-agent-user interaction benchmarks verify InteractCS-RL robustness across diverse domains. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_22697 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Reinforcing Real-world Service Agents: Balancing Utility and Cost in Task-oriented Dialogue Gao, Ning Zhang, Wei Dai, Yuqin Shi, Ling Wang, Ziyin Wang, Yujie He, Wei Wang, Jinpeng Wang, Chaozheng Computation and Language Artificial Intelligence The rapid evolution of Large Language Models (LLMs) has accelerated the transition from conversational chatbots to general agents. However, effectively balancing empathetic communication with budget-aware decision-making remains an open challenge. Since existing methods fail to capture these complex strategic trade-offs, we propose InteractCS-RL, a framework that reframes task-oriented dialogue as a multi-granularity reinforcement learning process. Specifically, we first establish a User-centric Interaction Framework to provide a high-fidelity training gym, enabling agents to dynamically explore diverse strategies with persona-driven users. Then, we introduce Cost-aware Multi-turn Policy Optimization (CMPO) with a hybrid advantage estimation strategy. By integrating generative process credits and employing a PID-Lagrangian cost controller, CMPO effectively guides the policy to explore Pareto boundary between user reward and global cost constraints. Extensive experiments on customized real business scenarios demonstrate that InteractCS-RL significantly outperform other baselines across three evaluation dimensions. Further evaluation on tool-agent-user interaction benchmarks verify InteractCS-RL robustness across diverse domains. |
| title | Reinforcing Real-world Service Agents: Balancing Utility and Cost in Task-oriented Dialogue |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2602.22697 |