Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2512.11745 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917142725656576 |
|---|---|
| author | Huang, Liqiang Mills, Rachel W. Mandula, Saikiran Bai, Lin Jeyhani, Mahtab Redell, John Van Nguyen, Hien Prasad, Saurabh Maric, Dragan Roysam, Badrinath |
| author_facet | Huang, Liqiang Mills, Rachel W. Mandula, Saikiran Bai, Lin Jeyhani, Mahtab Redell, John Van Nguyen, Hien Prasad, Saurabh Maric, Dragan Roysam, Badrinath |
| contents | Whole-slide multiplex imaging of brain tissue generates massive information-dense images that are challenging to analyze and require custom software. We present an alternative query-driven programming-free strategy using a multiplex visual search engine (mViSE) that learns the multifaceted brain tissue chemoarchitecture, cytoarchitecture, and myeloarchitecture. Our divide-and-conquer strategy organizes the data into panels of related molecular markers and uses self-supervised learning to train a multiplex encoder for each panel with explicit visual confirmation of successful learning. Multiple panels can be combined to process visual queries for retrieving similar communities of individual cells or multicellular niches using information-theoretic methods. The retrievals can be used for diverse purposes including tissue exploration, delineating brain regions and cortical cell layers, profiling and comparing brain regions without computer programming. We validated mViSE's ability to retrieve single cells, proximal cell pairs, tissue patches, delineate cortical layers, brain regions and sub-regions. mViSE is provided as an open-source QuPath plug-in. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_11745 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | mViSE: A Visual Search Engine for Analyzing Multiplex IHC Brain Tissue Images Huang, Liqiang Mills, Rachel W. Mandula, Saikiran Bai, Lin Jeyhani, Mahtab Redell, John Van Nguyen, Hien Prasad, Saurabh Maric, Dragan Roysam, Badrinath Image and Video Processing Computer Vision and Pattern Recognition Whole-slide multiplex imaging of brain tissue generates massive information-dense images that are challenging to analyze and require custom software. We present an alternative query-driven programming-free strategy using a multiplex visual search engine (mViSE) that learns the multifaceted brain tissue chemoarchitecture, cytoarchitecture, and myeloarchitecture. Our divide-and-conquer strategy organizes the data into panels of related molecular markers and uses self-supervised learning to train a multiplex encoder for each panel with explicit visual confirmation of successful learning. Multiple panels can be combined to process visual queries for retrieving similar communities of individual cells or multicellular niches using information-theoretic methods. The retrievals can be used for diverse purposes including tissue exploration, delineating brain regions and cortical cell layers, profiling and comparing brain regions without computer programming. We validated mViSE's ability to retrieve single cells, proximal cell pairs, tissue patches, delineate cortical layers, brain regions and sub-regions. mViSE is provided as an open-source QuPath plug-in. |
| title | mViSE: A Visual Search Engine for Analyzing Multiplex IHC Brain Tissue Images |
| topic | Image and Video Processing Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2512.11745 |