Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Survey
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2023
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910390244343808 |
|---|---|
| author | Ling, Chen Zhao, Xujiang Lu, Jiaying Deng, Chengyuan Zheng, Can Wang, Junxiang Chowdhury, Tanmoy Li, Yun Cui, Hejie Zhang, Xuchao Zhao, Tianjiao Panalkar, Amit Mehta, Dhagash Pasquali, Stefano Cheng, Wei Wang, Haoyu Liu, Yanchi Chen, Zhengzhang Chen, Haifeng White, Chris Gu, Quanquan Pei, Jian Yang, Carl Zhao, Liang |
| author_facet | Ling, Chen Zhao, Xujiang Lu, Jiaying Deng, Chengyuan Zheng, Can Wang, Junxiang Chowdhury, Tanmoy Li, Yun Cui, Hejie Zhang, Xuchao Zhao, Tianjiao Panalkar, Amit Mehta, Dhagash Pasquali, Stefano Cheng, Wei Wang, Haoyu Liu, Yanchi Chen, Zhengzhang Chen, Haifeng White, Chris Gu, Quanquan Pei, Jian Yang, Carl Zhao, Liang |
| contents | Large language models (LLMs) have significantly advanced the field of natural language processing (NLP), providing a highly useful, task-agnostic foundation for a wide range of applications. However, directly applying LLMs to solve sophisticated problems in specific domains meets many hurdles, caused by the heterogeneity of domain data, the sophistication of domain knowledge, the uniqueness of domain objectives, and the diversity of the constraints (e.g., various social norms, cultural conformity, religious beliefs, and ethical standards in the domain applications). Domain specification techniques are key to make large language models disruptive in many applications. Specifically, to solve these hurdles, there has been a notable increase in research and practices conducted in recent years on the domain specialization of LLMs. This emerging field of study, with its substantial potential for impact, necessitates a comprehensive and systematic review to better summarize and guide ongoing work in this area. In this article, we present a comprehensive survey on domain specification techniques for large language models, an emerging direction critical for large language model applications. First, we propose a systematic taxonomy that categorizes the LLM domain-specialization techniques based on the accessibility to LLMs and summarizes the framework for all the subcategories as well as their relations and differences to each other. Second, we present an extensive taxonomy of critical application domains that can benefit dramatically from specialized LLMs, discussing their practical significance and open challenges. Last, we offer our insights into the current research status and future trends in this area. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2305_18703 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Survey Ling, Chen Zhao, Xujiang Lu, Jiaying Deng, Chengyuan Zheng, Can Wang, Junxiang Chowdhury, Tanmoy Li, Yun Cui, Hejie Zhang, Xuchao Zhao, Tianjiao Panalkar, Amit Mehta, Dhagash Pasquali, Stefano Cheng, Wei Wang, Haoyu Liu, Yanchi Chen, Zhengzhang Chen, Haifeng White, Chris Gu, Quanquan Pei, Jian Yang, Carl Zhao, Liang Computation and Language Artificial Intelligence Large language models (LLMs) have significantly advanced the field of natural language processing (NLP), providing a highly useful, task-agnostic foundation for a wide range of applications. However, directly applying LLMs to solve sophisticated problems in specific domains meets many hurdles, caused by the heterogeneity of domain data, the sophistication of domain knowledge, the uniqueness of domain objectives, and the diversity of the constraints (e.g., various social norms, cultural conformity, religious beliefs, and ethical standards in the domain applications). Domain specification techniques are key to make large language models disruptive in many applications. Specifically, to solve these hurdles, there has been a notable increase in research and practices conducted in recent years on the domain specialization of LLMs. This emerging field of study, with its substantial potential for impact, necessitates a comprehensive and systematic review to better summarize and guide ongoing work in this area. In this article, we present a comprehensive survey on domain specification techniques for large language models, an emerging direction critical for large language model applications. First, we propose a systematic taxonomy that categorizes the LLM domain-specialization techniques based on the accessibility to LLMs and summarizes the framework for all the subcategories as well as their relations and differences to each other. Second, we present an extensive taxonomy of critical application domains that can benefit dramatically from specialized LLMs, discussing their practical significance and open challenges. Last, we offer our insights into the current research status and future trends in this area. |
| title | Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Survey |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2305.18703 |