Large Language Models Meet NLP: A Survey

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Qin, Libo, Chen, Qiguang, Feng, Xiachong, Wu, Yang, Zhang, Yongheng, Li, Yinghui, Li, Min, Che, Wanxiang, Yu, Philip S.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915458206138368
author Qin, Libo
Chen, Qiguang
Feng, Xiachong
Wu, Yang
Zhang, Yongheng
Li, Yinghui
Li, Min
Che, Wanxiang
Yu, Philip S.
author_facet Qin, Libo
Chen, Qiguang
Feng, Xiachong
Wu, Yang
Zhang, Yongheng
Li, Yinghui
Li, Min
Che, Wanxiang
Yu, Philip S.
contents While large language models (LLMs) like ChatGPT have shown impressive capabilities in Natural Language Processing (NLP) tasks, a systematic investigation of their potential in this field remains largely unexplored. This study aims to address this gap by exploring the following questions: (1) How are LLMs currently applied to NLP tasks in the literature? (2) Have traditional NLP tasks already been solved with LLMs? (3) What is the future of the LLMs for NLP? To answer these questions, we take the first step to provide a comprehensive overview of LLMs in NLP. Specifically, we first introduce a unified taxonomy including (1) parameter-frozen paradigm and (2) parameter-tuning paradigm to offer a unified perspective for understanding the current progress of LLMs in NLP. Furthermore, we summarize the new frontiers and the corresponding challenges, aiming to inspire further groundbreaking advancements. We hope this work offers valuable insights into the potential and limitations of LLMs, while also serving as a practical guide for building effective LLMs in NLP.
format Preprint
id arxiv_https___arxiv_org_abs_2405_12819
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Large Language Models Meet NLP: A Survey
Qin, Libo
Chen, Qiguang
Feng, Xiachong
Wu, Yang
Zhang, Yongheng
Li, Yinghui
Li, Min
Che, Wanxiang
Yu, Philip S.
Computation and Language
Artificial Intelligence
While large language models (LLMs) like ChatGPT have shown impressive capabilities in Natural Language Processing (NLP) tasks, a systematic investigation of their potential in this field remains largely unexplored. This study aims to address this gap by exploring the following questions: (1) How are LLMs currently applied to NLP tasks in the literature? (2) Have traditional NLP tasks already been solved with LLMs? (3) What is the future of the LLMs for NLP? To answer these questions, we take the first step to provide a comprehensive overview of LLMs in NLP. Specifically, we first introduce a unified taxonomy including (1) parameter-frozen paradigm and (2) parameter-tuning paradigm to offer a unified perspective for understanding the current progress of LLMs in NLP. Furthermore, we summarize the new frontiers and the corresponding challenges, aiming to inspire further groundbreaking advancements. We hope this work offers valuable insights into the potential and limitations of LLMs, while also serving as a practical guide for building effective LLMs in NLP.
title Large Language Models Meet NLP: A Survey
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2405.12819