Anatomical Positional Embeddings
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917776867721216 |
|---|---|
| author | Goncharov, Mikhail Samokhin, Valentin Soboleva, Eugenia Sokolov, Roman Shirokikh, Boris Belyaev, Mikhail Kurmukov, Anvar Oseledets, Ivan |
| author_facet | Goncharov, Mikhail Samokhin, Valentin Soboleva, Eugenia Sokolov, Roman Shirokikh, Boris Belyaev, Mikhail Kurmukov, Anvar Oseledets, Ivan |
| contents | We propose a self-supervised model producing 3D anatomical positional embeddings (APE) of individual medical image voxels. APE encodes voxels' anatomical closeness, i.e., voxels of the same organ or nearby organs always have closer positional embeddings than the voxels of more distant body parts. In contrast to the existing models of anatomical positional embeddings, our method is able to efficiently produce a map of voxel-wise embeddings for a whole volumetric input image, which makes it an optimal choice for different downstream applications. We train our APE model on 8400 publicly available CT images of abdomen and chest regions. We demonstrate its superior performance compared with the existing models on anatomical landmark retrieval and weakly-supervised few-shot localization of 13 abdominal organs. As a practical application, we show how to cheaply train APE to crop raw CT images to different anatomical regions of interest with 0.99 recall, while reducing the image volume by 10-100 times. The code and the pre-trained APE model are available at https://github.com/mishgon/ape . |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_10291 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Anatomical Positional Embeddings Goncharov, Mikhail Samokhin, Valentin Soboleva, Eugenia Sokolov, Roman Shirokikh, Boris Belyaev, Mikhail Kurmukov, Anvar Oseledets, Ivan Computer Vision and Pattern Recognition We propose a self-supervised model producing 3D anatomical positional embeddings (APE) of individual medical image voxels. APE encodes voxels' anatomical closeness, i.e., voxels of the same organ or nearby organs always have closer positional embeddings than the voxels of more distant body parts. In contrast to the existing models of anatomical positional embeddings, our method is able to efficiently produce a map of voxel-wise embeddings for a whole volumetric input image, which makes it an optimal choice for different downstream applications. We train our APE model on 8400 publicly available CT images of abdomen and chest regions. We demonstrate its superior performance compared with the existing models on anatomical landmark retrieval and weakly-supervised few-shot localization of 13 abdominal organs. As a practical application, we show how to cheaply train APE to crop raw CT images to different anatomical regions of interest with 0.99 recall, while reducing the image volume by 10-100 times. The code and the pre-trained APE model are available at https://github.com/mishgon/ape . |
| title | Anatomical Positional Embeddings |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2409.10291 |