Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | https://arxiv.org/abs/2411.05983 |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912470153560064 |
|---|---|
| author | Susman, Aviad Krishnamurthy, Rupak Li, Yan Chak Olaimat, Mohammad Bozdag, Serdar Varghese, Bino Sheikh-Bahaei, Nasim Pandey, Gaurav |
| author_facet | Susman, Aviad Krishnamurthy, Rupak Li, Yan Chak Olaimat, Mohammad Bozdag, Serdar Varghese, Bino Sheikh-Bahaei, Nasim Pandey, Gaurav |
| contents | Effectively modeling multimodal longitudinal data is a pressing need in various application areas, especially biomedicine. Despite this, few approaches exist in the literature for this problem, with most not adequately taking into account the multimodality of the data. In this study, we developed multiple configurations of a novel multimodal and longitudinal learning framework, Longitudinal Ensemble Integration (LEI), for sequential classification. We evaluated LEI's performance, and compared it against existing approaches, for the early detection of dementia, which is among the most studied multimodal sequential classification tasks. LEI outperformed these approaches due to its use of intermediate base predictions arising from the individual data modalities, which enabled their better integration over time. LEI's design also enabled the identification of features that were consistently important across time for the effective prediction of dementia-related diagnoses. Overall, our work demonstrates the potential of LEI for sequential classification from longitudinal multimodal data. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_05983 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Longitudinal Ensemble Integration for sequential classification with multimodal data Susman, Aviad Krishnamurthy, Rupak Li, Yan Chak Olaimat, Mohammad Bozdag, Serdar Varghese, Bino Sheikh-Bahaei, Nasim Pandey, Gaurav Machine Learning Artificial Intelligence Effectively modeling multimodal longitudinal data is a pressing need in various application areas, especially biomedicine. Despite this, few approaches exist in the literature for this problem, with most not adequately taking into account the multimodality of the data. In this study, we developed multiple configurations of a novel multimodal and longitudinal learning framework, Longitudinal Ensemble Integration (LEI), for sequential classification. We evaluated LEI's performance, and compared it against existing approaches, for the early detection of dementia, which is among the most studied multimodal sequential classification tasks. LEI outperformed these approaches due to its use of intermediate base predictions arising from the individual data modalities, which enabled their better integration over time. LEI's design also enabled the identification of features that were consistently important across time for the effective prediction of dementia-related diagnoses. Overall, our work demonstrates the potential of LEI for sequential classification from longitudinal multimodal data. |
| title | Longitudinal Ensemble Integration for sequential classification with multimodal data |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2411.05983 |