Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | https://arxiv.org/abs/2412.17759 |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909439372558336 |
|---|---|
| author | Pattnayak, Priyaranjan Patel, Hitesh Laxmichand Kumar, Bhargava Agarwal, Amit Banerjee, Ishan Panda, Srikant Kumar, Tejaswini |
| author_facet | Pattnayak, Priyaranjan Patel, Hitesh Laxmichand Kumar, Bhargava Agarwal, Amit Banerjee, Ishan Panda, Srikant Kumar, Tejaswini |
| contents | Multimodal learning, a rapidly evolving field in artificial intelligence, seeks to construct more versatile and robust systems by integrating and analyzing diverse types of data, including text, images, audio, and video. Inspired by the human ability to assimilate information through many senses, this method enables applications such as text-to-video conversion, visual question answering, and image captioning. Recent developments in datasets that support multimodal language models (MLLMs) are highlighted in this overview. Large-scale multimodal datasets are essential because they allow for thorough testing and training of these models. With an emphasis on their contributions to the discipline, the study examines a variety of datasets, including those for training, domain-specific tasks, and real-world applications. It also emphasizes how crucial benchmark datasets are for assessing models' performance in a range of scenarios, scalability, and applicability. Since multimodal learning is always changing, overcoming these obstacles will help AI research and applications reach new heights. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_17759 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Survey of Large Multimodal Model Datasets, Application Categories and Taxonomy Pattnayak, Priyaranjan Patel, Hitesh Laxmichand Kumar, Bhargava Agarwal, Amit Banerjee, Ishan Panda, Srikant Kumar, Tejaswini Artificial Intelligence Computer Vision and Pattern Recognition Machine Learning Multimodal learning, a rapidly evolving field in artificial intelligence, seeks to construct more versatile and robust systems by integrating and analyzing diverse types of data, including text, images, audio, and video. Inspired by the human ability to assimilate information through many senses, this method enables applications such as text-to-video conversion, visual question answering, and image captioning. Recent developments in datasets that support multimodal language models (MLLMs) are highlighted in this overview. Large-scale multimodal datasets are essential because they allow for thorough testing and training of these models. With an emphasis on their contributions to the discipline, the study examines a variety of datasets, including those for training, domain-specific tasks, and real-world applications. It also emphasizes how crucial benchmark datasets are for assessing models' performance in a range of scenarios, scalability, and applicability. Since multimodal learning is always changing, overcoming these obstacles will help AI research and applications reach new heights. |
| title | Survey of Large Multimodal Model Datasets, Application Categories and Taxonomy |
| topic | Artificial Intelligence Computer Vision and Pattern Recognition Machine Learning |
| url | https://arxiv.org/abs/2412.17759 |