Self-Supervised Masked Mesh Learning for Unsupervised Anomaly Detection on 3D Cortical Surfaces

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yang, Hao-Chun, Dai, Sicheng, Rutherford, Saige, Gaser, Christian, Marquand, Andre F, Beckmann, Christian F, Wolfers, Thomas
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915218272026624
author Yang, Hao-Chun
Dai, Sicheng
Rutherford, Saige
Gaser, Christian
Marquand, Andre F
Beckmann, Christian F
Wolfers, Thomas
author_facet Yang, Hao-Chun
Dai, Sicheng
Rutherford, Saige
Gaser, Christian
Marquand, Andre F
Beckmann, Christian F
Wolfers, Thomas
contents Unsupervised anomaly detection in brain imaging is challenging. In this paper, we propose self-supervised masked mesh learning for unsupervised anomaly detection on 3D cortical surfaces. Our framework leverages the intrinsic geometry of the cortical surface to learn a self-supervised representation that captures the underlying structure of the brain. We introduce a masked mesh convolutional neural network (MMN) that learns to predict masked regions of the cortical surface. By training the MMN on a large dataset of healthy subjects, we learn a representation that captures the normal variation in the cortical surface. We then use this representation to detect anomalies in unseen individuals by calculating anomaly scores based on the reconstruction error of the MMN. We evaluated our framework by training on population-scale dataset UKB and HCP-Aging and testing on two datasets of Alzheimer's disease patients ADNI and OASIS3. Our results show that our framework can detect anomalies in cortical thickness, cortical volume, and cortical sulcus characteristics, which are known to be biomarkers of Alzheimer's disease. Our proposed framework provides a promising approach for unsupervised anomaly detection based on normative variation of cortical features.
format Preprint
id arxiv_https___arxiv_org_abs_2412_05580
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Self-Supervised Masked Mesh Learning for Unsupervised Anomaly Detection on 3D Cortical Surfaces
Yang, Hao-Chun
Dai, Sicheng
Rutherford, Saige
Gaser, Christian
Marquand, Andre F
Beckmann, Christian F
Wolfers, Thomas
Image and Video Processing
Computer Vision and Pattern Recognition
Unsupervised anomaly detection in brain imaging is challenging. In this paper, we propose self-supervised masked mesh learning for unsupervised anomaly detection on 3D cortical surfaces. Our framework leverages the intrinsic geometry of the cortical surface to learn a self-supervised representation that captures the underlying structure of the brain. We introduce a masked mesh convolutional neural network (MMN) that learns to predict masked regions of the cortical surface. By training the MMN on a large dataset of healthy subjects, we learn a representation that captures the normal variation in the cortical surface. We then use this representation to detect anomalies in unseen individuals by calculating anomaly scores based on the reconstruction error of the MMN. We evaluated our framework by training on population-scale dataset UKB and HCP-Aging and testing on two datasets of Alzheimer's disease patients ADNI and OASIS3. Our results show that our framework can detect anomalies in cortical thickness, cortical volume, and cortical sulcus characteristics, which are known to be biomarkers of Alzheimer's disease. Our proposed framework provides a promising approach for unsupervised anomaly detection based on normative variation of cortical features.
title Self-Supervised Masked Mesh Learning for Unsupervised Anomaly Detection on 3D Cortical Surfaces
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.05580