Image de couverture de livre

A Tutorial on the Pretrain-Finetune Paradigm for Natural Language Processing

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Wang, Yu, Qu, Wen
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

ClusComp: A Simple Paradigm for Model Compression and Efficient Finetuning
par: Liao, Baohao, et autres
Publié: (2025)

Generalizable and Stable Finetuning of Pretrained Language Models on Low-Resource Texts
par: Somayajula, Sai Ashish, et autres
Publié: (2024)

Towards Consistent Natural-Language Explanations via Explanation-Consistency Finetuning
par: Chen, Yanda, et autres
Publié: (2024)

Whisper Finetuning on Nepali Language
par: Rijal, Sanjay, et autres
Publié: (2024)

Back to the Barn with LLAMAs: Evolving Pretrained LLM Backbones in Finetuning Vision Language Models
par: Horawalavithana, Sameera, et autres
Publié: (2026)

SpiroLLM: Finetuning Pretrained LLMs to Understand Spirogram Time Series with Clinical Validation in COPD Reporting
par: Mei, Shuhao, et autres
Publié: (2025)

Quantized Large Language Models in Biomedical Natural Language Processing: Evaluation and Recommendation
par: Zhan, Zaifu, et autres
Publié: (2025)

Advancements in Natural Language Processing: Exploring Transformer-Based Architectures for Text Understanding
par: Wu, Tianhao, et autres
Publié: (2025)

Planted in Pretraining, Swayed by Finetuning: A Case Study on the Origins of Cognitive Biases in LLMs
par: Itzhak, Itay, et autres
Publié: (2025)

Risk-Averse Finetuning of Large Language Models
par: Chaudhary, Sapana, et autres
Publié: (2025)

Misspellings in Natural Language Processing: A survey
par: Sperduti, Gianluca, et autres
Publié: (2025)

Genshin: General Shield for Natural Language Processing with Large Language Models
par: Peng, Xiao, et autres
Publié: (2024)

A Systematic Survey of Natural Language Processing for the Greek Language
par: Bakagianni, Juli, et autres
Publié: (2024)

Speciesism in Natural Language Processing Research
par: Takeshita, Masashi, et autres
Publié: (2024)

Natural Language Processing RELIES on Linguistics
par: Opitz, Juri, et autres
Publié: (2024)

Natural Language Processing in the Legal Domain
par: Hartung, Dirk, et autres
Publié: (2023)

BioInstruct: Instruction Tuning of Large Language Models for Biomedical Natural Language Processing
par: Tran, Hieu, et autres
Publié: (2023)

An evaluation of DeepSeek Models in Biomedical Natural Language Processing
par: Zhan, Zaifu, et autres
Publié: (2025)

A Scoping Review of Natural Language Processing in Addressing Medically Inaccurate Information: Errors, Misinformation, and Hallucination
par: Sun, Zhaoyi, et autres
Publié: (2025)

Continual Learning via Sparse Memory Finetuning
par: Lin, Jessy, et autres
Publié: (2025)

Computational Politeness in Natural Language Processing: A Survey
par: Priya, Priyanshu, et autres
Publié: (2024)

Natural Language Processing for Cardiology: A Narrative Review
par: Yang, Kailai, et autres
Publié: (2025)

Unitary Multi-Margin BERT for Robust Natural Language Processing
par: Chang, Hao-Yuan, et autres
Publié: (2024)

NAACL2025 Tutorial: Adaptation of Large Language Models
par: Ke, Zixuan, et autres
Publié: (2025)

FinGPT-HPC: Efficient Pretraining and Finetuning Large Language Models for Financial Applications with High-Performance Computing
par: Liu, Xiao-Yang, et autres
Publié: (2024)

Chinese Tiny LLM: Pretraining a Chinese-Centric Large Language Model
par: Du, Xinrun, et autres
Publié: (2024)

ReFT: Representation Finetuning for Language Models
par: Wu, Zhengxuan, et autres
Publié: (2024)

The Evolving Landscape of Generative Large Language Models and Traditional Natural Language Processing in Medicine
par: Yang, Rui, et autres
Publié: (2025)

CCI4.0: A Bilingual Pretraining Dataset for Enhancing Reasoning in Large Language Models
par: Liu, Guang, et autres
Publié: (2025)

Large Language Models to Diffusion Finetuning
par: Cetin, Edoardo, et autres
Publié: (2025)

LACIE: Listener-Aware Finetuning for Confidence Calibration in Large Language Models
par: Stengel-Eskin, Elias, et autres
Publié: (2024)

Vision-and-Language Navigation Generative Pretrained Transformer
par: Hanlin, Wen
Publié: (2024)

Explainability in Neural Networks for Natural Language Processing Tasks
par: Mersha, Melkamu, et autres
Publié: (2024)

ODD: A Benchmark Dataset for the Natural Language Processing based Opioid Related Aberrant Behavior Detection
par: Kwon, Sunjae, et autres
Publié: (2023)

Selecting Between BERT and GPT for Text Classification in Political Science Research
par: Wang, Yu, et autres
Publié: (2024)

RAG and RAU: A Survey on Retrieval-Augmented Language Model in Natural Language Processing
par: Hu, Yucheng, et autres
Publié: (2024)

Multilingual Pretraining for Pixel Language Models
par: Kesen, Ilker, et autres
Publié: (2025)

Finetuning Generative Large Language Models with Discrimination Instructions for Knowledge Graph Completion
par: Liu, Yang, et autres
Publié: (2024)

Improving Multilingual Instruction Finetuning via Linguistically Natural and Diverse Datasets
par: Indurthi, Sathish Reddy, et autres
Publié: (2024)

Extraction of Sleep Information from Clinical Notes of Patients with Alzheimer's Disease Using Natural Language Processing
par: Sivarajkumar, Sonish, et autres
Publié: (2022)