Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2407.19816 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910603231100928 |
|---|---|
| author | Matkin, Nikita Smirnov, Aleksei Usanin, Mikhail Ivanov, Egor Sobyanin, Kirill Paklina, Sofiia Parshakov, Petr |
| author_facet | Matkin, Nikita Smirnov, Aleksei Usanin, Mikhail Ivanov, Egor Sobyanin, Kirill Paklina, Sofiia Parshakov, Petr |
| contents | The labor market is undergoing rapid changes, with increasing demands on job seekers and a surge in job openings. Identifying essential skills and competencies from job descriptions is challenging due to varying employer requirements and the omission of key skills. This study addresses these challenges by comparing traditional Named Entity Recognition (NER) methods based on encoders with Large Language Models (LLMs) for extracting skills from Russian job vacancies. Using a labeled dataset of 4,000 job vacancies for training and 1,472 for testing, the performance of both approaches is evaluated. Results indicate that traditional NER models, especially DeepPavlov RuBERT NER tuned, outperform LLMs across various metrics including accuracy, precision, recall, and inference time. The findings suggest that traditional NER models provide more effective and efficient solutions for skill extraction, enhancing job requirement clarity and aiding job seekers in aligning their qualifications with employer expectations. This research contributes to the field of natural language processing (NLP) and its application in the labor market, particularly in non-English contexts. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_19816 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Comparative Analysis of Encoder-Based NER and Large Language Models for Skill Extraction from Russian Job Vacancies Matkin, Nikita Smirnov, Aleksei Usanin, Mikhail Ivanov, Egor Sobyanin, Kirill Paklina, Sofiia Parshakov, Petr Computation and Language The labor market is undergoing rapid changes, with increasing demands on job seekers and a surge in job openings. Identifying essential skills and competencies from job descriptions is challenging due to varying employer requirements and the omission of key skills. This study addresses these challenges by comparing traditional Named Entity Recognition (NER) methods based on encoders with Large Language Models (LLMs) for extracting skills from Russian job vacancies. Using a labeled dataset of 4,000 job vacancies for training and 1,472 for testing, the performance of both approaches is evaluated. Results indicate that traditional NER models, especially DeepPavlov RuBERT NER tuned, outperform LLMs across various metrics including accuracy, precision, recall, and inference time. The findings suggest that traditional NER models provide more effective and efficient solutions for skill extraction, enhancing job requirement clarity and aiding job seekers in aligning their qualifications with employer expectations. This research contributes to the field of natural language processing (NLP) and its application in the labor market, particularly in non-English contexts. |
| title | Comparative Analysis of Encoder-Based NER and Large Language Models for Skill Extraction from Russian Job Vacancies |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2407.19816 |