Partial GFlowNet: Accelerating Convergence in Large State Spaces via Strategic Partitioning

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Yu, Xuan, Wang, Xu, Zhu, Rui, Zhang, Yudong, Wang, Yang
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912899273850880
author Yu, Xuan
Wang, Xu
Zhu, Rui
Zhang, Yudong
Wang, Yang
author_facet Yu, Xuan
Wang, Xu
Zhu, Rui
Zhang, Yudong
Wang, Yang
contents Generative Flow Networks (GFlowNets) have shown promising potential to generate high-scoring candidates with probability proportional to their rewards. As existing GFlowNets freely explore in state space, they encounter significant convergence challenges when scaling to large state spaces. Addressing this issue, this paper proposes to restrict the exploration of actor. A planner is introduced to partition the entire state space into overlapping partial state spaces. Given their limited size, these partial state spaces allow the actor to efficiently identify subregions with higher rewards. A heuristic strategy is introduced to switch partial regions thus preventing the actor from wasting time exploring fully explored or low-reward partial regions. By iteratively exploring these partial state spaces, the actor learns to converge towards the high-reward subregions within the entire state space. Experiments on several widely used datasets demonstrate that \modelname converges faster than existing works on large state spaces. Furthermore, \modelname not only generates candidates with higher rewards but also significantly improves their diversity.
format Preprint
id arxiv_https___arxiv_org_abs_2602_11498
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Partial GFlowNet: Accelerating Convergence in Large State Spaces via Strategic Partitioning
Yu, Xuan
Wang, Xu
Zhu, Rui
Zhang, Yudong
Wang, Yang
Machine Learning
Generative Flow Networks (GFlowNets) have shown promising potential to generate high-scoring candidates with probability proportional to their rewards. As existing GFlowNets freely explore in state space, they encounter significant convergence challenges when scaling to large state spaces. Addressing this issue, this paper proposes to restrict the exploration of actor. A planner is introduced to partition the entire state space into overlapping partial state spaces. Given their limited size, these partial state spaces allow the actor to efficiently identify subregions with higher rewards. A heuristic strategy is introduced to switch partial regions thus preventing the actor from wasting time exploring fully explored or low-reward partial regions. By iteratively exploring these partial state spaces, the actor learns to converge towards the high-reward subregions within the entire state space. Experiments on several widely used datasets demonstrate that \modelname converges faster than existing works on large state spaces. Furthermore, \modelname not only generates candidates with higher rewards but also significantly improves their diversity.
title Partial GFlowNet: Accelerating Convergence in Large State Spaces via Strategic Partitioning
topic Machine Learning
url https://arxiv.org/abs/2602.11498