AntigenLM: Structure-Aware DNA Language Modeling for Influenza

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Pei, Yue, Chi, Xuebin, Kang, Yu
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908827335524352
author Pei, Yue
Chi, Xuebin
Kang, Yu
author_facet Pei, Yue
Chi, Xuebin
Kang, Yu
contents Language models have advanced sequence analysis, yet DNA foundation models often lag behind task-specific methods for unclear reasons. We present AntigenLM, a generative DNA language model pretrained on influenza genomes with intact, aligned functional units. This structure-aware pretraining enables AntigenLM to capture evolutionary constraints and generalize across tasks. Fine-tuned on time-series hemagglutinin (HA) and neuraminidase (NA) sequences, AntigenLM accurately forecasts future antigenic variants across regions and subtypes, including those unseen during training, outperforming phylogenetic and evolution-based models. It also achieves near-perfect subtype classification. Ablation studies show that disrupting genomic structure through fragmentation or shuffling severely degrades performance, revealing the importance of preserving functional-unit integrity in DNA language modeling. AntigenLM thus provides both a powerful framework for antigen evolution prediction and a general principle for building biologically grounded DNA foundation models.
format Preprint
id arxiv_https___arxiv_org_abs_2602_09067
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle AntigenLM: Structure-Aware DNA Language Modeling for Influenza
Pei, Yue
Chi, Xuebin
Kang, Yu
Genomics
Artificial Intelligence
Computational Engineering, Finance, and Science
Computation and Language
Language models have advanced sequence analysis, yet DNA foundation models often lag behind task-specific methods for unclear reasons. We present AntigenLM, a generative DNA language model pretrained on influenza genomes with intact, aligned functional units. This structure-aware pretraining enables AntigenLM to capture evolutionary constraints and generalize across tasks. Fine-tuned on time-series hemagglutinin (HA) and neuraminidase (NA) sequences, AntigenLM accurately forecasts future antigenic variants across regions and subtypes, including those unseen during training, outperforming phylogenetic and evolution-based models. It also achieves near-perfect subtype classification. Ablation studies show that disrupting genomic structure through fragmentation or shuffling severely degrades performance, revealing the importance of preserving functional-unit integrity in DNA language modeling. AntigenLM thus provides both a powerful framework for antigen evolution prediction and a general principle for building biologically grounded DNA foundation models.
title AntigenLM: Structure-Aware DNA Language Modeling for Influenza
topic Genomics
Artificial Intelligence
Computational Engineering, Finance, and Science
Computation and Language
url https://arxiv.org/abs/2602.09067