Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2502.14860 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909729856421888 |
|---|---|
| author | Li, Shuyue Stella Mun, Jimin Brahman, Faeze Hosseini, Pedram Thomas, Bryceton G. Sin, Jessica M. Ren, Bing Ilgen, Jonathan S. Tsvetkov, Yulia Sap, Maarten |
| author_facet | Li, Shuyue Stella Mun, Jimin Brahman, Faeze Hosseini, Pedram Thomas, Bryceton G. Sin, Jessica M. Ren, Bing Ilgen, Jonathan S. Tsvetkov, Yulia Sap, Maarten |
| contents | Large language models (LLMs) often fail to ask effective questions under uncertainty, making them unreliable in domains where proactive information-gathering is essential for decision-making. We present ALignment via Fine-grained Attributes, (ALFA) a framework that improves LLM question-asking by (i) decomposing the notion of a "good" question into a set of theory-grounded attributes (e.g., clarity, relevance), (ii) controllably synthesizing attribute-specific question variations, and (iii) aligning models via preference-based optimization to explicitly learn to ask better questions along these fine-grained attributes. Focusing on clinical reasoning as a case study, we introduce the MediQ-AskDocs dataset, composed of 17k real-world clinical interactions augmented with 80k attribute-specific preference pairs of follow-up questions, as well as a novel expert-annotated interactive healthcare QA task to evaluate question-asking abilities. Models aligned with ALFA reduce diagnostic errors by 56.6% on MediQ-AskDocs compared to SoTA instruction-tuned LLMs, with a question-level win-rate of 64.4% and strong generalizability. Our findings suggest that explicitly guiding question-asking with structured, fine-grained attributes offers a scalable path to improve LLMs, especially in expert application domains. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_14860 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | ALFA: Aligning LLMs to Ask Good Questions A Case Study in Clinical Reasoning Li, Shuyue Stella Mun, Jimin Brahman, Faeze Hosseini, Pedram Thomas, Bryceton G. Sin, Jessica M. Ren, Bing Ilgen, Jonathan S. Tsvetkov, Yulia Sap, Maarten Computation and Language Large language models (LLMs) often fail to ask effective questions under uncertainty, making them unreliable in domains where proactive information-gathering is essential for decision-making. We present ALignment via Fine-grained Attributes, (ALFA) a framework that improves LLM question-asking by (i) decomposing the notion of a "good" question into a set of theory-grounded attributes (e.g., clarity, relevance), (ii) controllably synthesizing attribute-specific question variations, and (iii) aligning models via preference-based optimization to explicitly learn to ask better questions along these fine-grained attributes. Focusing on clinical reasoning as a case study, we introduce the MediQ-AskDocs dataset, composed of 17k real-world clinical interactions augmented with 80k attribute-specific preference pairs of follow-up questions, as well as a novel expert-annotated interactive healthcare QA task to evaluate question-asking abilities. Models aligned with ALFA reduce diagnostic errors by 56.6% on MediQ-AskDocs compared to SoTA instruction-tuned LLMs, with a question-level win-rate of 64.4% and strong generalizability. Our findings suggest that explicitly guiding question-asking with structured, fine-grained attributes offers a scalable path to improve LLMs, especially in expert application domains. |
| title | ALFA: Aligning LLMs to Ask Good Questions A Case Study in Clinical Reasoning |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2502.14860 |