Saved in:
Bibliographic Details
Main Authors: Zhou, Dongmei, Tang, Xuri
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2409.18724
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914958916190208
author Zhou, Dongmei
Tang, Xuri
author_facet Zhou, Dongmei
Tang, Xuri
contents Domain dependence and annotation subjectivity pose challenges for supervised keyword extraction. Based on the premises that second-order keyness patterns are existent at the community level and learnable from annotated keyword extraction datasets, this paper proposes a supervised ranking approach to keyword extraction that ranks keywords with keyness patterns consisting of independent features (such as sublanguage domain and term length) and three categories of dependent features -- heuristic features, specificity features, and representavity features. The approach uses two convolutional-neural-network based models to learn keyness patterns from keyword datasets and overcomes annotation subjectivity by training the two models with bootstrap sampling strategy. Experiments demonstrate that the approach not only achieves state-of-the-art performance on ten keyword datasets in general supervised keyword extraction with an average top-10-F-measure of 0.316 , but also robust cross-domain performance with an average top-10-F-measure of 0.346 on four datasets that are excluded in the training process. Such cross-domain robustness is attributed to the fact that community-level keyness patterns are limited in number and temperately independent of language domains, the distinction between independent features and dependent features, and the sampling training strategy that balances excess risk and lack of negative training data.
format Preprint
id arxiv_https___arxiv_org_abs_2409_18724
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Cross-Domain Keyword Extraction with Keyness Patterns
Zhou, Dongmei
Tang, Xuri
Information Retrieval
Computation and Language
Neural and Evolutionary Computing
H.3.1; H.3.3
Domain dependence and annotation subjectivity pose challenges for supervised keyword extraction. Based on the premises that second-order keyness patterns are existent at the community level and learnable from annotated keyword extraction datasets, this paper proposes a supervised ranking approach to keyword extraction that ranks keywords with keyness patterns consisting of independent features (such as sublanguage domain and term length) and three categories of dependent features -- heuristic features, specificity features, and representavity features. The approach uses two convolutional-neural-network based models to learn keyness patterns from keyword datasets and overcomes annotation subjectivity by training the two models with bootstrap sampling strategy. Experiments demonstrate that the approach not only achieves state-of-the-art performance on ten keyword datasets in general supervised keyword extraction with an average top-10-F-measure of 0.316 , but also robust cross-domain performance with an average top-10-F-measure of 0.346 on four datasets that are excluded in the training process. Such cross-domain robustness is attributed to the fact that community-level keyness patterns are limited in number and temperately independent of language domains, the distinction between independent features and dependent features, and the sampling training strategy that balances excess risk and lack of negative training data.
title Cross-Domain Keyword Extraction with Keyness Patterns
topic Information Retrieval
Computation and Language
Neural and Evolutionary Computing
H.3.1; H.3.3
url https://arxiv.org/abs/2409.18724