Saved in:
Bibliographic Details
Main Authors: Matkin, Nikita, Smirnov, Aleksei, Usanin, Mikhail, Ivanov, Egor, Sobyanin, Kirill, Paklina, Sofiia, Parshakov, Petr
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2407.19816
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910603231100928
author Matkin, Nikita
Smirnov, Aleksei
Usanin, Mikhail
Ivanov, Egor
Sobyanin, Kirill
Paklina, Sofiia
Parshakov, Petr
author_facet Matkin, Nikita
Smirnov, Aleksei
Usanin, Mikhail
Ivanov, Egor
Sobyanin, Kirill
Paklina, Sofiia
Parshakov, Petr
contents The labor market is undergoing rapid changes, with increasing demands on job seekers and a surge in job openings. Identifying essential skills and competencies from job descriptions is challenging due to varying employer requirements and the omission of key skills. This study addresses these challenges by comparing traditional Named Entity Recognition (NER) methods based on encoders with Large Language Models (LLMs) for extracting skills from Russian job vacancies. Using a labeled dataset of 4,000 job vacancies for training and 1,472 for testing, the performance of both approaches is evaluated. Results indicate that traditional NER models, especially DeepPavlov RuBERT NER tuned, outperform LLMs across various metrics including accuracy, precision, recall, and inference time. The findings suggest that traditional NER models provide more effective and efficient solutions for skill extraction, enhancing job requirement clarity and aiding job seekers in aligning their qualifications with employer expectations. This research contributes to the field of natural language processing (NLP) and its application in the labor market, particularly in non-English contexts.
format Preprint
id arxiv_https___arxiv_org_abs_2407_19816
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Comparative Analysis of Encoder-Based NER and Large Language Models for Skill Extraction from Russian Job Vacancies
Matkin, Nikita
Smirnov, Aleksei
Usanin, Mikhail
Ivanov, Egor
Sobyanin, Kirill
Paklina, Sofiia
Parshakov, Petr
Computation and Language
The labor market is undergoing rapid changes, with increasing demands on job seekers and a surge in job openings. Identifying essential skills and competencies from job descriptions is challenging due to varying employer requirements and the omission of key skills. This study addresses these challenges by comparing traditional Named Entity Recognition (NER) methods based on encoders with Large Language Models (LLMs) for extracting skills from Russian job vacancies. Using a labeled dataset of 4,000 job vacancies for training and 1,472 for testing, the performance of both approaches is evaluated. Results indicate that traditional NER models, especially DeepPavlov RuBERT NER tuned, outperform LLMs across various metrics including accuracy, precision, recall, and inference time. The findings suggest that traditional NER models provide more effective and efficient solutions for skill extraction, enhancing job requirement clarity and aiding job seekers in aligning their qualifications with employer expectations. This research contributes to the field of natural language processing (NLP) and its application in the labor market, particularly in non-English contexts.
title Comparative Analysis of Encoder-Based NER and Large Language Models for Skill Extraction from Russian Job Vacancies
topic Computation and Language
url https://arxiv.org/abs/2407.19816