Saved in:
Bibliographic Details
Main Authors: Hashim, Sayed, Soboczenski, Frank, Cairns, Paul
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2604.00739
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918423485743104
author Hashim, Sayed
Soboczenski, Frank
Cairns, Paul
author_facet Hashim, Sayed
Soboczenski, Frank
Cairns, Paul
contents Datasets used in immunotherapy response prediction are typically small in size, as well as diverse in cancer type, drug administered, and sequencer used. Models often drop in performance when tested on patient cohorts that are not included in the training process. Recent work has shown that transformer-based models along with self-supervised learning show better generalisation performance than threshold-based biomarkers, but is still suboptimal. We present BioCOMPASS, an extension of a transformer-based model called COMPASS, that integrates biomarkers and treatment information to further improve its generalisability. Instead of feeding biomarker data as input, we built loss components to align them with the model's intermediate representations. We found that components such as treatment gating and pathway consistency loss improved generalisability when evaluated with Leave-one-cohort-out, Leave-one-cancer-type-out and Leave-one-treatment-out strategies. Results show that building components that exploit biomarker and treatment information can help in generalisability of immunotherapy response prediction. Careful curation of additional components that leverage complementary clinical information and domain knowledge represents a promising direction for future research.
format Preprint
id arxiv_https___arxiv_org_abs_2604_00739
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle BioCOMPASS: Integrating Biomarkers into Transformer-Based Immunotherapy Response Prediction
Hashim, Sayed
Soboczenski, Frank
Cairns, Paul
Machine Learning
Artificial Intelligence
Datasets used in immunotherapy response prediction are typically small in size, as well as diverse in cancer type, drug administered, and sequencer used. Models often drop in performance when tested on patient cohorts that are not included in the training process. Recent work has shown that transformer-based models along with self-supervised learning show better generalisation performance than threshold-based biomarkers, but is still suboptimal. We present BioCOMPASS, an extension of a transformer-based model called COMPASS, that integrates biomarkers and treatment information to further improve its generalisability. Instead of feeding biomarker data as input, we built loss components to align them with the model's intermediate representations. We found that components such as treatment gating and pathway consistency loss improved generalisability when evaluated with Leave-one-cohort-out, Leave-one-cancer-type-out and Leave-one-treatment-out strategies. Results show that building components that exploit biomarker and treatment information can help in generalisability of immunotherapy response prediction. Careful curation of additional components that leverage complementary clinical information and domain knowledge represents a promising direction for future research.
title BioCOMPASS: Integrating Biomarkers into Transformer-Based Immunotherapy Response Prediction
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2604.00739