Parameter-Efficient Fine-Tuning of Large Language Models using Semantic Knowledge Tuning
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866917800518352896 |
|---|---|
| author | Prottasha, Nusrat Jahan Mahmud, Asif Sobuj, Md. Shohanur Islam Bhat, Prakash Kowsher, Md Yousefi, Niloofar Garibay, Ozlem Ozmen |
| author_facet | Prottasha, Nusrat Jahan Mahmud, Asif Sobuj, Md. Shohanur Islam Bhat, Prakash Kowsher, Md Yousefi, Niloofar Garibay, Ozlem Ozmen |
| contents | Large Language Models (LLMs) are gaining significant popularity in recent years for specialized tasks using prompts due to their low computational cost. Standard methods like prefix tuning utilize special, modifiable tokens that lack semantic meaning and require extensive training for best performance, often falling short. In this context, we propose a novel method called Semantic Knowledge Tuning (SK-Tuning) for prompt and prefix tuning that employs meaningful words instead of random tokens. This method involves using a fixed LLM to understand and process the semantic content of the prompt through zero-shot capabilities. Following this, it integrates the processed prompt with the input text to improve the model's performance on particular tasks. Our experimental results show that SK-Tuning exhibits faster training times, fewer parameters, and superior performance on tasks such as text classification and understanding compared to other tuning methods. This approach offers a promising method for optimizing the efficiency and effectiveness of LLMs in processing language tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_08598 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Parameter-Efficient Fine-Tuning of Large Language Models using Semantic Knowledge Tuning Prottasha, Nusrat Jahan Mahmud, Asif Sobuj, Md. Shohanur Islam Bhat, Prakash Kowsher, Md Yousefi, Niloofar Garibay, Ozlem Ozmen Computation and Language Large Language Models (LLMs) are gaining significant popularity in recent years for specialized tasks using prompts due to their low computational cost. Standard methods like prefix tuning utilize special, modifiable tokens that lack semantic meaning and require extensive training for best performance, often falling short. In this context, we propose a novel method called Semantic Knowledge Tuning (SK-Tuning) for prompt and prefix tuning that employs meaningful words instead of random tokens. This method involves using a fixed LLM to understand and process the semantic content of the prompt through zero-shot capabilities. Following this, it integrates the processed prompt with the input text to improve the model's performance on particular tasks. Our experimental results show that SK-Tuning exhibits faster training times, fewer parameters, and superior performance on tasks such as text classification and understanding compared to other tuning methods. This approach offers a promising method for optimizing the efficiency and effectiveness of LLMs in processing language tasks. |
| title | Parameter-Efficient Fine-Tuning of Large Language Models using Semantic Knowledge Tuning |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2410.08598 |