Saved in:
Bibliographic Details
Main Authors: Cao, Yihan, Chen, Xu, Du, Lun, Chen, Hao, Fu, Qiang, Han, Shi, Du, Yushu, Kang, Yanbin, Lu, Guangming, Li, Zi
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2401.07525
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929213959831552
author Cao, Yihan
Chen, Xu
Du, Lun
Chen, Hao
Fu, Qiang
Han, Shi
Du, Yushu
Kang, Yanbin
Lu, Guangming
Li, Zi
author_facet Cao, Yihan
Chen, Xu
Du, Lun
Chen, Hao
Fu, Qiang
Han, Shi
Du, Yushu
Kang, Yanbin
Lu, Guangming
Li, Zi
contents Person-job fit is an essential part of online recruitment platforms in serving various downstream applications like Job Search and Candidate Recommendation. Recently, pretrained large language models have further enhanced the effectiveness by leveraging richer textual information in user profiles and job descriptions apart from user behavior features and job metadata. However, the general domain-oriented design struggles to capture the unique structural information within user profiles and job descriptions, leading to a loss of latent semantic correlations. We propose TAROT, a hierarchical multitask co-pretraining framework, to better utilize structural and semantic information for informative text embeddings. TAROT targets semi-structured text in profiles and jobs, and it is co-pretained with multi-grained pretraining tasks to constrain the acquired semantic information at each level. Experiments on a real-world LinkedIn dataset show significant performance improvements, proving its effectiveness in person-job fit tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2401_07525
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle TAROT: A Hierarchical Framework with Multitask Co-Pretraining on Semi-Structured Data towards Effective Person-Job Fit
Cao, Yihan
Chen, Xu
Du, Lun
Chen, Hao
Fu, Qiang
Han, Shi
Du, Yushu
Kang, Yanbin
Lu, Guangming
Li, Zi
Computation and Language
Artificial Intelligence
Person-job fit is an essential part of online recruitment platforms in serving various downstream applications like Job Search and Candidate Recommendation. Recently, pretrained large language models have further enhanced the effectiveness by leveraging richer textual information in user profiles and job descriptions apart from user behavior features and job metadata. However, the general domain-oriented design struggles to capture the unique structural information within user profiles and job descriptions, leading to a loss of latent semantic correlations. We propose TAROT, a hierarchical multitask co-pretraining framework, to better utilize structural and semantic information for informative text embeddings. TAROT targets semi-structured text in profiles and jobs, and it is co-pretained with multi-grained pretraining tasks to constrain the acquired semantic information at each level. Experiments on a real-world LinkedIn dataset show significant performance improvements, proving its effectiveness in person-job fit tasks.
title TAROT: A Hierarchical Framework with Multitask Co-Pretraining on Semi-Structured Data towards Effective Person-Job Fit
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2401.07525