Saved in:
| Main Author: | |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.06395 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910641407655936 |
|---|---|
| author | Huang, Weichen |
| author_facet | Huang, Weichen |
| contents | Multimodal contrastive learning train neural networks by levergaing data from heterogeneous sources such as images and text. Yet, many current multimodal learning architectures cannot generalize to an arbitrary number of modalities and need to be hand-constructed. We propose AutoBIND, a novel contrastive learning framework that can learn representations from an arbitrary number of modalites through graph optimization. We evaluate AutoBIND on Alzhiemer's disease detection because it has real-world medical applicability and it contains a broad range of data modalities. We show that AutoBIND outperforms previous methods on this task, highlighting the generalizablility of the approach. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_06395 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Multimodal Representation Learning using Adaptive Graph Construction Huang, Weichen Machine Learning Artificial Intelligence Multimodal contrastive learning train neural networks by levergaing data from heterogeneous sources such as images and text. Yet, many current multimodal learning architectures cannot generalize to an arbitrary number of modalities and need to be hand-constructed. We propose AutoBIND, a novel contrastive learning framework that can learn representations from an arbitrary number of modalites through graph optimization. We evaluate AutoBIND on Alzhiemer's disease detection because it has real-world medical applicability and it contains a broad range of data modalities. We show that AutoBIND outperforms previous methods on this task, highlighting the generalizablility of the approach. |
| title | Multimodal Representation Learning using Adaptive Graph Construction |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2410.06395 |