Saved in:
Bibliographic Details
Main Authors: Nguyen, Khanh Cao, Zhang, Mike, Montariol, Syrielle, Bosselut, Antoine
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2402.03832
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911772010610688
author Nguyen, Khanh Cao
Zhang, Mike
Montariol, Syrielle
Bosselut, Antoine
author_facet Nguyen, Khanh Cao
Zhang, Mike
Montariol, Syrielle
Bosselut, Antoine
contents Skill Extraction involves identifying skills and qualifications mentioned in documents such as job postings and resumes. The task is commonly tackled by training supervised models using a sequence labeling approach with BIO tags. However, the reliance on manually annotated data limits the generalizability of such approaches. Moreover, the common BIO setting limits the ability of the models to capture complex skill patterns and handle ambiguous mentions. In this paper, we explore the use of in-context learning to overcome these challenges, on a benchmark of 6 uniformized skill extraction datasets. Our approach leverages the few-shot learning capabilities of large language models (LLMs) to identify and extract skills from sentences. We show that LLMs, despite not being on par with traditional supervised models in terms of performance, can better handle syntactically complex skill mentions in skill extraction tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2402_03832
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Rethinking Skill Extraction in the Job Market Domain using Large Language Models
Nguyen, Khanh Cao
Zhang, Mike
Montariol, Syrielle
Bosselut, Antoine
Computation and Language
Skill Extraction involves identifying skills and qualifications mentioned in documents such as job postings and resumes. The task is commonly tackled by training supervised models using a sequence labeling approach with BIO tags. However, the reliance on manually annotated data limits the generalizability of such approaches. Moreover, the common BIO setting limits the ability of the models to capture complex skill patterns and handle ambiguous mentions. In this paper, we explore the use of in-context learning to overcome these challenges, on a benchmark of 6 uniformized skill extraction datasets. Our approach leverages the few-shot learning capabilities of large language models (LLMs) to identify and extract skills from sentences. We show that LLMs, despite not being on par with traditional supervised models in terms of performance, can better handle syntactically complex skill mentions in skill extraction tasks.
title Rethinking Skill Extraction in the Job Market Domain using Large Language Models
topic Computation and Language
url https://arxiv.org/abs/2402.03832