Saved in:
| Main Authors: | , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2509.12772 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909791166660608 |
|---|---|
| author | Agbelese, Damola Chaitanya, Krishna Pati, Pushpak Parmar, Chaitanya Mobadersany, Pooya Fadnavis, Shreyas Surace, Lindsey Yarandi, Shadi Ghanem, Louis R. Lucas, Molly Mansi, Tommaso Cula, Oana Gabriela Damasceno, Pablo F. Standish, Kristopher |
| author_facet | Agbelese, Damola Chaitanya, Krishna Pati, Pushpak Parmar, Chaitanya Mobadersany, Pooya Fadnavis, Shreyas Surace, Lindsey Yarandi, Shadi Ghanem, Louis R. Lucas, Molly Mansi, Tommaso Cula, Oana Gabriela Damasceno, Pablo F. Standish, Kristopher |
| contents | Reliable uncertainty quantification (UQ) is essential in medical AI. Evidential Deep Learning (EDL) offers a computationally efficient way to quantify model uncertainty alongside predictions, unlike traditional methods such as Monte Carlo (MC) Dropout and Deep Ensembles (DE). However, all these methods often rely on a single expert's annotations as ground truth for model training, overlooking the inter-rater variability in healthcare. To address this issue, we propose MEGAN, a Multi-Expert Gating Network that aggregates uncertainty estimates and predictions from multiple AI experts via EDL models trained with diverse ground truths and modeling strategies. MEGAN's gating network optimally combines predictions and uncertainties from each EDL model, enhancing overall prediction confidence and calibration. We extensively benchmark MEGAN on endoscopy videos for Ulcerative colitis (UC) disease severity estimation, assessed by visual labeling of Mayo Endoscopic Subscore (MES), where inter-rater variability is prevalent. In large-scale prospective UC clinical trial, MEGAN achieved a 3.5% improvement in F1-score and a 30.5% reduction in Expected Calibration Error (ECE) compared to existing methods. Furthermore, MEGAN facilitated uncertainty-guided sample stratification, reducing the annotation burden and potentially increasing efficiency and consistency in UC trials. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_12772 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | MEGAN: Mixture of Experts for Robust Uncertainty Estimation in Endoscopy Videos Agbelese, Damola Chaitanya, Krishna Pati, Pushpak Parmar, Chaitanya Mobadersany, Pooya Fadnavis, Shreyas Surace, Lindsey Yarandi, Shadi Ghanem, Louis R. Lucas, Molly Mansi, Tommaso Cula, Oana Gabriela Damasceno, Pablo F. Standish, Kristopher Image and Video Processing Artificial Intelligence Computer Vision and Pattern Recognition Machine Learning Reliable uncertainty quantification (UQ) is essential in medical AI. Evidential Deep Learning (EDL) offers a computationally efficient way to quantify model uncertainty alongside predictions, unlike traditional methods such as Monte Carlo (MC) Dropout and Deep Ensembles (DE). However, all these methods often rely on a single expert's annotations as ground truth for model training, overlooking the inter-rater variability in healthcare. To address this issue, we propose MEGAN, a Multi-Expert Gating Network that aggregates uncertainty estimates and predictions from multiple AI experts via EDL models trained with diverse ground truths and modeling strategies. MEGAN's gating network optimally combines predictions and uncertainties from each EDL model, enhancing overall prediction confidence and calibration. We extensively benchmark MEGAN on endoscopy videos for Ulcerative colitis (UC) disease severity estimation, assessed by visual labeling of Mayo Endoscopic Subscore (MES), where inter-rater variability is prevalent. In large-scale prospective UC clinical trial, MEGAN achieved a 3.5% improvement in F1-score and a 30.5% reduction in Expected Calibration Error (ECE) compared to existing methods. Furthermore, MEGAN facilitated uncertainty-guided sample stratification, reducing the annotation burden and potentially increasing efficiency and consistency in UC trials. |
| title | MEGAN: Mixture of Experts for Robust Uncertainty Estimation in Endoscopy Videos |
| topic | Image and Video Processing Artificial Intelligence Computer Vision and Pattern Recognition Machine Learning |
| url | https://arxiv.org/abs/2509.12772 |