TAKT: Target-Aware Knowledge Transfer for Whole Slide Image Classification

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Xiong, Conghao, Lin, Yi, Chen, Hao, Zheng, Hao, Wei, Dong, Zheng, Yefeng, Sung, Joseph J. Y., King, Irwin
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909249915846656
author Xiong, Conghao
Lin, Yi
Chen, Hao
Zheng, Hao
Wei, Dong
Zheng, Yefeng
Sung, Joseph J. Y.
King, Irwin
author_facet Xiong, Conghao
Lin, Yi
Chen, Hao
Zheng, Hao
Wei, Dong
Zheng, Yefeng
Sung, Joseph J. Y.
King, Irwin
contents Transferring knowledge from a source domain to a target domain can be crucial for whole slide image classification, since the number of samples in a dataset is often limited due to high annotation costs. However, domain shift and task discrepancy between datasets can hinder effective knowledge transfer. In this paper, we propose a Target-Aware Knowledge Transfer framework, employing a teacher-student paradigm. Our framework enables the teacher model to learn common knowledge from the source and target domains by actively incorporating unlabelled target images into the training of the teacher model. The teacher bag features are subsequently adapted to supervise the training of the student model on the target domain. Despite incorporating the target features during training, the teacher model tends to overlook them under the inherent domain shift and task discrepancy. To alleviate this, we introduce a target-aware feature alignment module to establish a transferable latent relationship between the source and target features by solving the optimal transport problem. Experimental results show that models employing knowledge transfer outperform those trained from scratch, and our method achieves state-of-the-art performance among other knowledge transfer methods on various datasets, including TCGA-RCC, TCGA-NSCLC, and Camelyon16.
format Preprint
id arxiv_https___arxiv_org_abs_2303_05780
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle TAKT: Target-Aware Knowledge Transfer for Whole Slide Image Classification
Xiong, Conghao
Lin, Yi
Chen, Hao
Zheng, Hao
Wei, Dong
Zheng, Yefeng
Sung, Joseph J. Y.
King, Irwin
Computer Vision and Pattern Recognition
Artificial Intelligence
Transferring knowledge from a source domain to a target domain can be crucial for whole slide image classification, since the number of samples in a dataset is often limited due to high annotation costs. However, domain shift and task discrepancy between datasets can hinder effective knowledge transfer. In this paper, we propose a Target-Aware Knowledge Transfer framework, employing a teacher-student paradigm. Our framework enables the teacher model to learn common knowledge from the source and target domains by actively incorporating unlabelled target images into the training of the teacher model. The teacher bag features are subsequently adapted to supervise the training of the student model on the target domain. Despite incorporating the target features during training, the teacher model tends to overlook them under the inherent domain shift and task discrepancy. To alleviate this, we introduce a target-aware feature alignment module to establish a transferable latent relationship between the source and target features by solving the optimal transport problem. Experimental results show that models employing knowledge transfer outperform those trained from scratch, and our method achieves state-of-the-art performance among other knowledge transfer methods on various datasets, including TCGA-RCC, TCGA-NSCLC, and Camelyon16.
title TAKT: Target-Aware Knowledge Transfer for Whole Slide Image Classification
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2303.05780