Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2506.09173 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918054680592384 |
|---|---|
| author | Cooper, Michael Wadhawan, Rohan Giorgi, John Michael Tan, Chenhao Liang, Davis |
| author_facet | Cooper, Michael Wadhawan, Rohan Giorgi, John Michael Tan, Chenhao Liang, Davis |
| contents | Decision-makers often possess insufficient information to render a confident decision. In these cases, the decision-maker can often undertake actions to acquire the necessary information about the problem at hand, e.g., by consulting knowledgeable authorities or by conducting experiments. Importantly, different levers of information acquisition come with different costs, posing the challenge of selecting the actions that are both informative and cost-effective. In this work, we propose CuriosiTree, a heuristic-based, test-time policy for zero-shot information acquisition in large language models (LLMs). CuriosiTree employs a greedy tree search to estimate the expected information gain of each action and strategically chooses actions based on a balance of anticipated information gain and associated cost. Empirical validation in a clinical diagnosis simulation shows that CuriosiTree enables cost-effective integration of heterogenous sources of information, and outperforms baseline action selection strategies in selecting action sequences that enable accurate diagnosis. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_09173 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | The Curious Language Model: Strategic Test-Time Information Acquisition Cooper, Michael Wadhawan, Rohan Giorgi, John Michael Tan, Chenhao Liang, Davis Machine Learning Computation and Language Decision-makers often possess insufficient information to render a confident decision. In these cases, the decision-maker can often undertake actions to acquire the necessary information about the problem at hand, e.g., by consulting knowledgeable authorities or by conducting experiments. Importantly, different levers of information acquisition come with different costs, posing the challenge of selecting the actions that are both informative and cost-effective. In this work, we propose CuriosiTree, a heuristic-based, test-time policy for zero-shot information acquisition in large language models (LLMs). CuriosiTree employs a greedy tree search to estimate the expected information gain of each action and strategically chooses actions based on a balance of anticipated information gain and associated cost. Empirical validation in a clinical diagnosis simulation shows that CuriosiTree enables cost-effective integration of heterogenous sources of information, and outperforms baseline action selection strategies in selecting action sequences that enable accurate diagnosis. |
| title | The Curious Language Model: Strategic Test-Time Information Acquisition |
| topic | Machine Learning Computation and Language |
| url | https://arxiv.org/abs/2506.09173 |