Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2509.17570 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914050575695872 |
|---|---|
| author | Troshin, Sergey Saparina, Irina Fokkens, Antske Niculae, Vlad |
| author_facet | Troshin, Sergey Saparina, Irina Fokkens, Antske Niculae, Vlad |
| contents | Large language models increasingly rely on explicit reasoning chains and can produce multiple plausible responses for a given context. We study the candidate sampler that produces the set of plausible responses contrasting the ancestral (parallel) sampling against two alternatives: enumeration, which asks the model to produce $n$ candidates in one pass, and iterative sampling, which proposes candidates sequentially while conditioning on the currently generated response set. Under matched budgets, we compare these samplers on quality, lexical and computation flow diversity, and efficiency. Our empirical results demonstrate that enumeration and iterative strategies result in higher diversity at comparable quality. Our findings highlight the potential of simple non-independent sampling strategies to improve response diversity without sacrificing generation quality. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_17570 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Asking a Language Model for Diverse Responses Troshin, Sergey Saparina, Irina Fokkens, Antske Niculae, Vlad Computation and Language Large language models increasingly rely on explicit reasoning chains and can produce multiple plausible responses for a given context. We study the candidate sampler that produces the set of plausible responses contrasting the ancestral (parallel) sampling against two alternatives: enumeration, which asks the model to produce $n$ candidates in one pass, and iterative sampling, which proposes candidates sequentially while conditioning on the currently generated response set. Under matched budgets, we compare these samplers on quality, lexical and computation flow diversity, and efficiency. Our empirical results demonstrate that enumeration and iterative strategies result in higher diversity at comparable quality. Our findings highlight the potential of simple non-independent sampling strategies to improve response diversity without sacrificing generation quality. |
| title | Asking a Language Model for Diverse Responses |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2509.17570 |