An overview of domain-specific foundation model: key technologies, applications and challenges
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908546060255232 |
|---|---|
| author | Chen, Haolong Chen, Hanzhi Zhao, Zijian Han, Kaifeng Zhu, Guangxu Zhao, Yichen Du, Ying Xu, Wei Shi, Qingjiang |
| author_facet | Chen, Haolong Chen, Hanzhi Zhao, Zijian Han, Kaifeng Zhu, Guangxu Zhao, Yichen Du, Ying Xu, Wei Shi, Qingjiang |
| contents | The impressive performance of ChatGPT and other foundation-model-based products in human language understanding has prompted both academia and industry to explore how these models can be tailored for specific industries and application scenarios. This process, known as the customization of domain-specific foundation models (FMs), addresses the limitations of general-purpose models, which may not fully capture the unique patterns and requirements of domain-specific data. Despite its importance, there is a notable lack of comprehensive overview papers on building domain-specific FMs, while numerous resources exist for general-purpose models. To bridge this gap, this article provides a timely and thorough overview of the methodology for customizing domain-specific FMs. It introduces basic concepts, outlines the general architecture, and surveys key methods for constructing domain-specific models. Furthermore, the article discusses various domains that can benefit from these specialized models and highlights the challenges ahead. Through this overview, we aim to offer valuable guidance and reference for researchers and practitioners from diverse fields to develop their own customized FMs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_04267 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | An overview of domain-specific foundation model: key technologies, applications and challenges Chen, Haolong Chen, Hanzhi Zhao, Zijian Han, Kaifeng Zhu, Guangxu Zhao, Yichen Du, Ying Xu, Wei Shi, Qingjiang Artificial Intelligence Computation and Language The impressive performance of ChatGPT and other foundation-model-based products in human language understanding has prompted both academia and industry to explore how these models can be tailored for specific industries and application scenarios. This process, known as the customization of domain-specific foundation models (FMs), addresses the limitations of general-purpose models, which may not fully capture the unique patterns and requirements of domain-specific data. Despite its importance, there is a notable lack of comprehensive overview papers on building domain-specific FMs, while numerous resources exist for general-purpose models. To bridge this gap, this article provides a timely and thorough overview of the methodology for customizing domain-specific FMs. It introduces basic concepts, outlines the general architecture, and surveys key methods for constructing domain-specific models. Furthermore, the article discusses various domains that can benefit from these specialized models and highlights the challenges ahead. Through this overview, we aim to offer valuable guidance and reference for researchers and practitioners from diverse fields to develop their own customized FMs. |
| title | An overview of domain-specific foundation model: key technologies, applications and challenges |
| topic | Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2409.04267 |