Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2403.19930 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917625282428928 |
|---|---|
| author | Liu, Shulin Xu, Chengcheng Liu, Hao Yu, Tinghao Yang, Tao |
| author_facet | Liu, Shulin Xu, Chengcheng Liu, Hao Yu, Tinghao Yang, Tao |
| contents | The recent success of Large Language Models (LLMs) has garnered significant attention in both academia and industry. Prior research on LLMs has primarily focused on enhancing or leveraging their generalization capabilities in zero- and few-shot settings. However, there has been limited investigation into effectively fine-tuning LLMs for a specific natural language understanding task in supervised settings. In this study, we conduct an experimental analysis by fine-tuning LLMs for the task of Chinese short text matching. We explore various factors that influence performance when fine-tuning LLMs, including task modeling methods, prompt formats, and output formats. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_19930 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Are LLMs Effective Backbones for Fine-tuning? An Experimental Investigation of Supervised LLMs on Chinese Short Text Matching Liu, Shulin Xu, Chengcheng Liu, Hao Yu, Tinghao Yang, Tao Computation and Language The recent success of Large Language Models (LLMs) has garnered significant attention in both academia and industry. Prior research on LLMs has primarily focused on enhancing or leveraging their generalization capabilities in zero- and few-shot settings. However, there has been limited investigation into effectively fine-tuning LLMs for a specific natural language understanding task in supervised settings. In this study, we conduct an experimental analysis by fine-tuning LLMs for the task of Chinese short text matching. We explore various factors that influence performance when fine-tuning LLMs, including task modeling methods, prompt formats, and output formats. |
| title | Are LLMs Effective Backbones for Fine-tuning? An Experimental Investigation of Supervised LLMs on Chinese Short Text Matching |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2403.19930 |