Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2503.01819 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912257168900096 |
|---|---|
| author | Gupta, Adesh Kumar, Abhinav Gupta, Mansi Chopra, Paras |
| author_facet | Gupta, Adesh Kumar, Abhinav Gupta, Mansi Chopra, Paras |
| contents | Generating diverse solutions is key to human-like reasoning, yet autoregressive language models focus on single accurate responses, limiting creativity. GFlowNets optimize solution generation as a flow network, promising greater diversity. Our case study shows their limited zero-shot transferability by fine-tuning small and medium-sized large language models on the Game of 24 and testing them on the Game of 42 datasets. Results revealed that GFlowNets struggle to maintain solution diversity and accuracy, highlighting key limitations in their cross-task generalization and the need for future research in improved transfer learning capabilities. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_01819 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Do GFlowNets Transfer? Case Study on the Game of 24/42 Gupta, Adesh Kumar, Abhinav Gupta, Mansi Chopra, Paras Artificial Intelligence Computation and Language Generating diverse solutions is key to human-like reasoning, yet autoregressive language models focus on single accurate responses, limiting creativity. GFlowNets optimize solution generation as a flow network, promising greater diversity. Our case study shows their limited zero-shot transferability by fine-tuning small and medium-sized large language models on the Game of 24 and testing them on the Game of 42 datasets. Results revealed that GFlowNets struggle to maintain solution diversity and accuracy, highlighting key limitations in their cross-task generalization and the need for future research in improved transfer learning capabilities. |
| title | Do GFlowNets Transfer? Case Study on the Game of 24/42 |
| topic | Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2503.01819 |