Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2404.13067 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929321599303680 |
|---|---|
| author | Jiang, Feihu Qin, Chuan Zhang, Jingshuai Yao, Kaichun Chen, Xi Shen, Dazhong Zhu, Chen Zhu, Hengshu Xiong, Hui |
| author_facet | Jiang, Feihu Qin, Chuan Zhang, Jingshuai Yao, Kaichun Chen, Xi Shen, Dazhong Zhu, Chen Zhu, Hengshu Xiong, Hui |
| contents | In the contemporary era of widespread online recruitment, resume understanding has been widely acknowledged as a fundamental and crucial task, which aims to extract structured information from resume documents automatically. Compared to the traditional rule-based approaches, the utilization of recently proposed pre-trained document understanding models can greatly enhance the effectiveness of resume understanding. The present approaches have, however, disregarded the hierarchical relations within the structured information presented in resumes, and have difficulty parsing resumes in an efficient manner. To this end, in this paper, we propose a novel model, namely ERU, to achieve efficient resume understanding. Specifically, we first introduce a layout-aware multi-modal fusion transformer for encoding the segments in the resume with integrated textual, visual, and layout information. Then, we design three self-supervised tasks to pre-train this module via a large number of unlabeled resumes. Next, we fine-tune the model with a multi-granularity sequence labeling task to extract structured information from resumes. Finally, extensive experiments on a real-world dataset clearly demonstrate the effectiveness of ERU. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_13067 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Towards Efficient Resume Understanding: A Multi-Granularity Multi-Modal Pre-Training Approach Jiang, Feihu Qin, Chuan Zhang, Jingshuai Yao, Kaichun Chen, Xi Shen, Dazhong Zhu, Chen Zhu, Hengshu Xiong, Hui Computation and Language Artificial Intelligence Machine Learning In the contemporary era of widespread online recruitment, resume understanding has been widely acknowledged as a fundamental and crucial task, which aims to extract structured information from resume documents automatically. Compared to the traditional rule-based approaches, the utilization of recently proposed pre-trained document understanding models can greatly enhance the effectiveness of resume understanding. The present approaches have, however, disregarded the hierarchical relations within the structured information presented in resumes, and have difficulty parsing resumes in an efficient manner. To this end, in this paper, we propose a novel model, namely ERU, to achieve efficient resume understanding. Specifically, we first introduce a layout-aware multi-modal fusion transformer for encoding the segments in the resume with integrated textual, visual, and layout information. Then, we design three self-supervised tasks to pre-train this module via a large number of unlabeled resumes. Next, we fine-tune the model with a multi-granularity sequence labeling task to extract structured information from resumes. Finally, extensive experiments on a real-world dataset clearly demonstrate the effectiveness of ERU. |
| title | Towards Efficient Resume Understanding: A Multi-Granularity Multi-Modal Pre-Training Approach |
| topic | Computation and Language Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2404.13067 |