Tokensome: Towards a Genetic Vision-Language GPT for Explainable and Cognitive Karyotyping
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909139257524224 |
|---|---|
| author | Zhang, Haoxi Zhang, Xinxu Lin, Yuanxin Wang, Maiqi Lai, Yi Wang, Yu Yu, Linfeng Xu, Yufeng Cheng, Ran Szczerbicki, Edward |
| author_facet | Zhang, Haoxi Zhang, Xinxu Lin, Yuanxin Wang, Maiqi Lai, Yi Wang, Yu Yu, Linfeng Xu, Yufeng Cheng, Ran Szczerbicki, Edward |
| contents | Automatic karyotype analysis is often defined as a visual perception task focused solely on chromosomal object-level modeling. This definition has led most existing methods to overlook componential and holistic information, significantly constraining model performance. Moreover, the lack of interpretability in current technologies hinders clinical adoption. In this paper, we introduce Tokensome, a novel vision-language model based on chromosome tokenization for explainable and cognitive karyotyping. Tokensome elevates the method from the conventional visual perception layer to the cognitive decision-making layer. This elevation enables the integration of domain knowledge and cognitive reasoning via knowledge graphs and LLMs, markedly enhancing model's explainability and facilitating abnormality detection. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_11073 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Tokensome: Towards a Genetic Vision-Language GPT for Explainable and Cognitive Karyotyping Zhang, Haoxi Zhang, Xinxu Lin, Yuanxin Wang, Maiqi Lai, Yi Wang, Yu Yu, Linfeng Xu, Yufeng Cheng, Ran Szczerbicki, Edward Computer Vision and Pattern Recognition Artificial Intelligence Automatic karyotype analysis is often defined as a visual perception task focused solely on chromosomal object-level modeling. This definition has led most existing methods to overlook componential and holistic information, significantly constraining model performance. Moreover, the lack of interpretability in current technologies hinders clinical adoption. In this paper, we introduce Tokensome, a novel vision-language model based on chromosome tokenization for explainable and cognitive karyotyping. Tokensome elevates the method from the conventional visual perception layer to the cognitive decision-making layer. This elevation enables the integration of domain knowledge and cognitive reasoning via knowledge graphs and LLMs, markedly enhancing model's explainability and facilitating abnormality detection. |
| title | Tokensome: Towards a Genetic Vision-Language GPT for Explainable and Cognitive Karyotyping |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence |
| url | https://arxiv.org/abs/2403.11073 |