Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Waizman, Itzik, Gusakov, Yakov, Benou, Itay, Raviv, Tammy Riklin
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2509.16429
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912595490897920
author Waizman, Itzik
Gusakov, Yakov
Benou, Itay
Raviv, Tammy Riklin
author_facet Waizman, Itzik
Gusakov, Yakov
Benou, Itay
Raviv, Tammy Riklin
contents White matter tractography is an advanced neuroimaging technique that reconstructs the 3D white matter pathways of the brain from diffusion MRI data. It can be framed as a pathfinding problem aiming to infer neural fiber trajectories from noisy and ambiguous measurements, facing challenges such as crossing, merging, and fanning white-matter configurations. In this paper, we propose a novel tractography method that leverages Transformers to model the sequential nature of white matter streamlines, enabling the prediction of fiber directions by integrating both the trajectory context and current diffusion MRI measurements. To incorporate spatial information, we utilize CNNs that extract microstructural features from local neighborhoods around each voxel. By combining these complementary sources of information, our approach improves the precision and completeness of neural pathway mapping compared to traditional tractography models. We evaluate our method with the Tractometer toolkit, achieving competitive performance against state-of-the-art approaches, and present qualitative results on the TractoInferno dataset, demonstrating strong generalization to real-world data.
format Preprint
id arxiv_https___arxiv_org_abs_2509_16429
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle TractoTransformer: Diffusion MRI Streamline Tractography using CNN and Transformer Networks
Waizman, Itzik
Gusakov, Yakov
Benou, Itay
Raviv, Tammy Riklin
Computer Vision and Pattern Recognition
White matter tractography is an advanced neuroimaging technique that reconstructs the 3D white matter pathways of the brain from diffusion MRI data. It can be framed as a pathfinding problem aiming to infer neural fiber trajectories from noisy and ambiguous measurements, facing challenges such as crossing, merging, and fanning white-matter configurations. In this paper, we propose a novel tractography method that leverages Transformers to model the sequential nature of white matter streamlines, enabling the prediction of fiber directions by integrating both the trajectory context and current diffusion MRI measurements. To incorporate spatial information, we utilize CNNs that extract microstructural features from local neighborhoods around each voxel. By combining these complementary sources of information, our approach improves the precision and completeness of neural pathway mapping compared to traditional tractography models. We evaluate our method with the Tractometer toolkit, achieving competitive performance against state-of-the-art approaches, and present qualitative results on the TractoInferno dataset, demonstrating strong generalization to real-world data.
title TractoTransformer: Diffusion MRI Streamline Tractography using CNN and Transformer Networks
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.16429