Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2510.21801 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917041576869888 |
|---|---|
| author | Tliba, Marouane Kerkouri, Mohamed Amine Nasser, Yassine Aburaed, Nour Chetouani, Aladine Bagci, Ulas Jennane, Rachid |
| author_facet | Tliba, Marouane Kerkouri, Mohamed Amine Nasser, Yassine Aburaed, Nour Chetouani, Aladine Bagci, Ulas Jennane, Rachid |
| contents | Knee osteoarthritis (KOA) diagnosis from radiographs remains challenging due to the subtle morphological details that standard deep learning models struggle to capture effectively. We propose a novel multimodal framework that combines anatomical structure with radiographic features by integrating a morphological graph representation - derived from Segment Anything Model (SAM) segmentations - with a vision encoder. Our approach enforces alignment between geometry-informed graph embeddings and radiographic features through mutual information maximization, significantly improving KOA classification accuracy. By constructing graphs from anatomical features, we introduce explicit morphological priors that mirror clinical assessment criteria, enriching the feature space and enhancing the model's inductive bias. Experiments on the Osteoarthritis Initiative dataset demonstrate that our approach surpasses single-modality baselines by up to 10\% in accuracy (reaching nearly 80\%), while outperforming existing state-of-the-art methods by 8\% in accuracy and 11\% in F1 score. These results underscore the critical importance of incorporating anatomical structure into radiographic analysis for accurate KOA severity grading. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_21801 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Morphology-Aware KOA Classification: Integrating Graph Priors with Vision Models Tliba, Marouane Kerkouri, Mohamed Amine Nasser, Yassine Aburaed, Nour Chetouani, Aladine Bagci, Ulas Jennane, Rachid Computer Vision and Pattern Recognition Machine Learning Knee osteoarthritis (KOA) diagnosis from radiographs remains challenging due to the subtle morphological details that standard deep learning models struggle to capture effectively. We propose a novel multimodal framework that combines anatomical structure with radiographic features by integrating a morphological graph representation - derived from Segment Anything Model (SAM) segmentations - with a vision encoder. Our approach enforces alignment between geometry-informed graph embeddings and radiographic features through mutual information maximization, significantly improving KOA classification accuracy. By constructing graphs from anatomical features, we introduce explicit morphological priors that mirror clinical assessment criteria, enriching the feature space and enhancing the model's inductive bias. Experiments on the Osteoarthritis Initiative dataset demonstrate that our approach surpasses single-modality baselines by up to 10\% in accuracy (reaching nearly 80\%), while outperforming existing state-of-the-art methods by 8\% in accuracy and 11\% in F1 score. These results underscore the critical importance of incorporating anatomical structure into radiographic analysis for accurate KOA severity grading. |
| title | Morphology-Aware KOA Classification: Integrating Graph Priors with Vision Models |
| topic | Computer Vision and Pattern Recognition Machine Learning |
| url | https://arxiv.org/abs/2510.21801 |