Harnessing Preference Optimisation in Protein LMs for Hit Maturation in Cell Therapy

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Janocha, Katarzyna, Ling, Annabel, Godson, Alice, Lampi, Yulia, Bornschein, Simon, Hammerla, Nils Y.
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912142328856576
author Janocha, Katarzyna
Ling, Annabel
Godson, Alice
Lampi, Yulia
Bornschein, Simon
Hammerla, Nils Y.
author_facet Janocha, Katarzyna
Ling, Annabel
Godson, Alice
Lampi, Yulia
Bornschein, Simon
Hammerla, Nils Y.
contents Cell and immunotherapy offer transformative potential for treating diseases like cancer and autoimmune disorders by modulating the immune system. The development of these therapies is resource-intensive, with the majority of drug candidates failing to progress beyond laboratory testing. While recent advances in machine learning have revolutionised areas such as protein engineering, applications in immunotherapy remain limited due to the scarcity of large-scale, standardised datasets and the complexity of cellular systems. In this work, we address these challenges by leveraging a high-throughput experimental platform to generate data suitable for fine-tuning protein language models. We demonstrate how models fine-tuned using a preference task show surprising correlations to biological assays, and how they can be leveraged for few-shot hit maturation in CARs. This proof-of-concept presents a novel pathway for applying ML to immunotherapy and could generalise to other therapeutic modalities.
format Preprint
id arxiv_https___arxiv_org_abs_2412_01388
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Harnessing Preference Optimisation in Protein LMs for Hit Maturation in Cell Therapy
Janocha, Katarzyna
Ling, Annabel
Godson, Alice
Lampi, Yulia
Bornschein, Simon
Hammerla, Nils Y.
Machine Learning
Cell and immunotherapy offer transformative potential for treating diseases like cancer and autoimmune disorders by modulating the immune system. The development of these therapies is resource-intensive, with the majority of drug candidates failing to progress beyond laboratory testing. While recent advances in machine learning have revolutionised areas such as protein engineering, applications in immunotherapy remain limited due to the scarcity of large-scale, standardised datasets and the complexity of cellular systems. In this work, we address these challenges by leveraging a high-throughput experimental platform to generate data suitable for fine-tuning protein language models. We demonstrate how models fine-tuned using a preference task show surprising correlations to biological assays, and how they can be leveraged for few-shot hit maturation in CARs. This proof-of-concept presents a novel pathway for applying ML to immunotherapy and could generalise to other therapeutic modalities.
title Harnessing Preference Optimisation in Protein LMs for Hit Maturation in Cell Therapy
topic Machine Learning
url https://arxiv.org/abs/2412.01388