Uncertainty as a Planning Signal: Multi-Turn Decision Making for Goal-Oriented Conversation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ling, Xinyi, Liu, Ye, Averly, Reza, Ning, Xia
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913005646643200
author Ling, Xinyi
Liu, Ye
Averly, Reza
Ning, Xia
author_facet Ling, Xinyi
Liu, Ye
Averly, Reza
Ning, Xia
contents Goal-oriented conversational systems require making sequential decisions under uncertainty about the user's intent, where the algorithm must balance information acquisition and target commitment over multiple turns. Existing approaches address this challenge from different perspectives: structured methods enable multi-step planning but rely on predefined schemas, while LLM-based approaches support flexible interactions but lack long-horizon decision making, resulting in poor coordination between information acquisition and target commitment. To address this limitation, we formulate goal-oriented conversation as an uncertainty-aware sequential decision problem, where uncertainty serves as a guiding signal for multi-turn decision making. We propose a Conversation Uncertainty-aware Planning framework (CUP) that integrates language models with structured planning: a language model proposes feasible actions, and a planner evaluates their long-term impact on uncertainty reduction. Experiments on multiple conversational benchmarks show that CUP consistently improves success rates while requiring fewer interaction turns. Further analysis demonstrates that uncertainty-aware planning contributes to more efficient information acquisition and earlier confident commitment.
format Preprint
id arxiv_https___arxiv_org_abs_2604_03924
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Uncertainty as a Planning Signal: Multi-Turn Decision Making for Goal-Oriented Conversation
Ling, Xinyi
Liu, Ye
Averly, Reza
Ning, Xia
Computation and Language
Artificial Intelligence
Goal-oriented conversational systems require making sequential decisions under uncertainty about the user's intent, where the algorithm must balance information acquisition and target commitment over multiple turns. Existing approaches address this challenge from different perspectives: structured methods enable multi-step planning but rely on predefined schemas, while LLM-based approaches support flexible interactions but lack long-horizon decision making, resulting in poor coordination between information acquisition and target commitment. To address this limitation, we formulate goal-oriented conversation as an uncertainty-aware sequential decision problem, where uncertainty serves as a guiding signal for multi-turn decision making. We propose a Conversation Uncertainty-aware Planning framework (CUP) that integrates language models with structured planning: a language model proposes feasible actions, and a planner evaluates their long-term impact on uncertainty reduction. Experiments on multiple conversational benchmarks show that CUP consistently improves success rates while requiring fewer interaction turns. Further analysis demonstrates that uncertainty-aware planning contributes to more efficient information acquisition and earlier confident commitment.
title Uncertainty as a Planning Signal: Multi-Turn Decision Making for Goal-Oriented Conversation
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2604.03924