Curriculum-Augmented GFlowNets For mRNA Sequence Generation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Laajil, Aya, Shtanchaev, Abduragim, Muhammad, Sajan, Moulines, Eric, Lahlou, Salem
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918154497687552
author Laajil, Aya
Shtanchaev, Abduragim
Muhammad, Sajan
Moulines, Eric
Lahlou, Salem
author_facet Laajil, Aya
Shtanchaev, Abduragim
Muhammad, Sajan
Moulines, Eric
Lahlou, Salem
contents Designing mRNA sequences is a major challenge in developing next-generation therapeutics, since it involves exploring a vast space of possible nucleotide combinations while optimizing sequence properties like stability, translation efficiency, and protein expression. While Generative Flow Networks are promising for this task, their training is hindered by sparse, long-horizon rewards and multi-objective trade-offs. We propose Curriculum-Augmented GFlowNets (CAGFN), which integrate curriculum learning with multi-objective GFlowNets to generate de novo mRNA sequences. CAGFN integrates a length-based curriculum that progressively adapts the maximum sequence length guiding exploration from easier to harder subproblems. We also provide a new mRNA design environment for GFlowNets which, given a target protein sequence and a combination of biological objectives, allows for the training of models that generate plausible mRNA candidates. This provides a biologically motivated setting for applying and advancing GFlowNets in therapeutic sequence design. On different mRNA design tasks, CAGFN improves Pareto performance and biological plausibility, while maintaining diversity. Moreover, CAGFN reaches higher-quality solutions faster than a GFlowNet trained with random sequence sampling (no curriculum), and enables generalization to out-of-distribution sequences.
format Preprint
id arxiv_https___arxiv_org_abs_2510_03811
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Curriculum-Augmented GFlowNets For mRNA Sequence Generation
Laajil, Aya
Shtanchaev, Abduragim
Muhammad, Sajan
Moulines, Eric
Lahlou, Salem
Machine Learning
Quantitative Methods
Designing mRNA sequences is a major challenge in developing next-generation therapeutics, since it involves exploring a vast space of possible nucleotide combinations while optimizing sequence properties like stability, translation efficiency, and protein expression. While Generative Flow Networks are promising for this task, their training is hindered by sparse, long-horizon rewards and multi-objective trade-offs. We propose Curriculum-Augmented GFlowNets (CAGFN), which integrate curriculum learning with multi-objective GFlowNets to generate de novo mRNA sequences. CAGFN integrates a length-based curriculum that progressively adapts the maximum sequence length guiding exploration from easier to harder subproblems. We also provide a new mRNA design environment for GFlowNets which, given a target protein sequence and a combination of biological objectives, allows for the training of models that generate plausible mRNA candidates. This provides a biologically motivated setting for applying and advancing GFlowNets in therapeutic sequence design. On different mRNA design tasks, CAGFN improves Pareto performance and biological plausibility, while maintaining diversity. Moreover, CAGFN reaches higher-quality solutions faster than a GFlowNet trained with random sequence sampling (no curriculum), and enables generalization to out-of-distribution sequences.
title Curriculum-Augmented GFlowNets For mRNA Sequence Generation
topic Machine Learning
Quantitative Methods
url https://arxiv.org/abs/2510.03811