Saved in:
Bibliographic Details
Main Authors: Oberstrass, Alexander, Vaca, Esteban, Upschulte, Eric, Niu, Meiqi, Palomero-Gallagher, Nicola, Graessel, David, Schiffer, Christian, Axer, Markus, Amunts, Katrin, Dickscheid, Timo
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2505.11394
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914189805617152
author Oberstrass, Alexander
Vaca, Esteban
Upschulte, Eric
Niu, Meiqi
Palomero-Gallagher, Nicola
Graessel, David
Schiffer, Christian
Axer, Markus
Amunts, Katrin
Dickscheid, Timo
author_facet Oberstrass, Alexander
Vaca, Esteban
Upschulte, Eric
Niu, Meiqi
Palomero-Gallagher, Nicola
Graessel, David
Schiffer, Christian
Axer, Markus
Amunts, Katrin
Dickscheid, Timo
contents Comprehensive assessment of the various aspects of the brain's microstructure requires the use of complementary imaging techniques. This includes measuring the spatial distribution of cell bodies (cytoarchitecture) and nerve fibers (myeloarchitecture). The gold standard for cytoarchitectonic analysis is light microscopic imaging of cell-body stained tissue sections. To reveal the 3D orientations of nerve fibers, 3D Polarized Light Imaging (3D-PLI) has been introduced, a method that is label-free and allows subsequent staining of sections after 3D-PLI measurement. By post-staining for cell bodies, a direct link between fiber- and cytoarchitecture can potentially be established in the same section. However, inevitable distortions introduced during the staining process make a costly nonlinear and cross-modal registration necessary in order to study the detailed relationships between cells and fibers in the images. In addition, the complexity of processing histological sections for post-staining only allows for a limited number of such samples. In this work, we take advantage of deep learning methods for image-to-image translation to generate a virtual staining of 3D-PLI that is spatially aligned at the cellular level. We use a supervised setting, building on a unique dataset of brain sections, to which Cresyl violet staining has been applied after 3D-PLI measurement. To ensure high correspondence between both modalities, we address the misalignment of training data using Fourier-based registration. In this way, registration can be efficiently calculated during training for local image patches of target and predicted staining. We demonstrate that the proposed method can predict a Cresyl violet staining from 3D-PLI, resulting in a virtual staining that exhibits plausible patterns of cell organization in gray matter, with larger cell bodies being localized at their expected positions.
format Preprint
id arxiv_https___arxiv_org_abs_2505_11394
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle From Fibers to Cells: Fourier-Based Registration Enables Virtual Cresyl Violet Staining From 3D Polarized Light Imaging
Oberstrass, Alexander
Vaca, Esteban
Upschulte, Eric
Niu, Meiqi
Palomero-Gallagher, Nicola
Graessel, David
Schiffer, Christian
Axer, Markus
Amunts, Katrin
Dickscheid, Timo
Image and Video Processing
Computer Vision and Pattern Recognition
Comprehensive assessment of the various aspects of the brain's microstructure requires the use of complementary imaging techniques. This includes measuring the spatial distribution of cell bodies (cytoarchitecture) and nerve fibers (myeloarchitecture). The gold standard for cytoarchitectonic analysis is light microscopic imaging of cell-body stained tissue sections. To reveal the 3D orientations of nerve fibers, 3D Polarized Light Imaging (3D-PLI) has been introduced, a method that is label-free and allows subsequent staining of sections after 3D-PLI measurement. By post-staining for cell bodies, a direct link between fiber- and cytoarchitecture can potentially be established in the same section. However, inevitable distortions introduced during the staining process make a costly nonlinear and cross-modal registration necessary in order to study the detailed relationships between cells and fibers in the images. In addition, the complexity of processing histological sections for post-staining only allows for a limited number of such samples. In this work, we take advantage of deep learning methods for image-to-image translation to generate a virtual staining of 3D-PLI that is spatially aligned at the cellular level. We use a supervised setting, building on a unique dataset of brain sections, to which Cresyl violet staining has been applied after 3D-PLI measurement. To ensure high correspondence between both modalities, we address the misalignment of training data using Fourier-based registration. In this way, registration can be efficiently calculated during training for local image patches of target and predicted staining. We demonstrate that the proposed method can predict a Cresyl violet staining from 3D-PLI, resulting in a virtual staining that exhibits plausible patterns of cell organization in gray matter, with larger cell bodies being localized at their expected positions.
title From Fibers to Cells: Fourier-Based Registration Enables Virtual Cresyl Violet Staining From 3D Polarized Light Imaging
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.11394