Large Language Model Enhanced Machine Learning Estimators for Classification

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wu, Yuhang, Wang, Yingfei, Wang, Chu, Zheng, Zeyu
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911871080071168
author Wu, Yuhang
Wang, Yingfei
Wang, Chu
Zheng, Zeyu
author_facet Wu, Yuhang
Wang, Yingfei
Wang, Chu
Zheng, Zeyu
contents Pre-trained large language models (LLM) have emerged as a powerful tool for simulating various scenarios and generating output given specific instructions and multimodal input. In this work, we analyze the specific use of LLM to enhance a classical supervised machine learning method for classification problems. We propose a few approaches to integrate LLM into a classical machine learning estimator to further enhance the prediction performance. We examine the performance of the proposed approaches through both standard supervised learning binary classification tasks, and a transfer learning task where the test data observe distribution changes compared to the training data. Numerical experiments using four publicly available datasets are conducted and suggest that using LLM to enhance classical machine learning estimators can provide significant improvement on prediction performance.
format Preprint
id arxiv_https___arxiv_org_abs_2405_05445
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Large Language Model Enhanced Machine Learning Estimators for Classification
Wu, Yuhang
Wang, Yingfei
Wang, Chu
Zheng, Zeyu
Machine Learning
Pre-trained large language models (LLM) have emerged as a powerful tool for simulating various scenarios and generating output given specific instructions and multimodal input. In this work, we analyze the specific use of LLM to enhance a classical supervised machine learning method for classification problems. We propose a few approaches to integrate LLM into a classical machine learning estimator to further enhance the prediction performance. We examine the performance of the proposed approaches through both standard supervised learning binary classification tasks, and a transfer learning task where the test data observe distribution changes compared to the training data. Numerical experiments using four publicly available datasets are conducted and suggest that using LLM to enhance classical machine learning estimators can provide significant improvement on prediction performance.
title Large Language Model Enhanced Machine Learning Estimators for Classification
topic Machine Learning
url https://arxiv.org/abs/2405.05445