Saved in:
| Main Authors: | , |
|---|---|
| Format: | Recurso educativo Open Access |
| Language: | en |
| Published: |
2001
|
| Subjects: | |
| Online Access: | https://eric.ed.gov/?id=ED459824 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1867181723675000832 |
|---|---|
| author | Jones, Steve Paynter, Gordon W. |
| author_facet | Jones, Steve Paynter, Gordon W. Jones, Steve Paynter, Gordon W. |
| collection | Education Resources Information Center |
| contents | Human Evaluation of Kea, an Automatic Keyphrasing System. Jones, Steve Paynter, Gordon W. Computer Interfaces Data Processing Electronic Libraries Information Retrieval Information Systems Keywords Man Machine Systems User Satisfaction (Information) Users (Information) This paper describes an evaluation of the Kea automatic keyphrase extraction algorithm. Tools that automatically identify keyphrases are desirable because document keyphrases have numerous applications in digital library systems, but are costly and time consuming to manually assign. Keyphrase extraction algorithms are usually evaluated by comparison to author-specified keywords, but this methodology has several well-known shortcomings. The results presented in this paper are based on subjective evaluations of the quality and appropriateness of keyphrases by human assessors, and make a number of contributions. First, they validate previous evaluations of Kea that rely on author keywords. Second, they show Kea's performance is comparable to that of similar systems that have been evaluated by human assessors. Finally, they justify the use of author keyphrases as a performance metric by showing that authors generally choose good keywords. (Contains 28 references.) (Author) |
| format | Recurso educativo Open Access |
| id | eric_ED459824 |
| institution | ERIC Institute of Education Sciences |
| language | en |
| publishDate | 2001 |
| record_format | eric |
| spellingShingle | Human Evaluation of Kea, an Automatic Keyphrasing System. Jones, Steve Paynter, Gordon W. Computer Interfaces Data Processing Electronic Libraries Information Retrieval Information Systems Keywords Man Machine Systems User Satisfaction (Information) Users (Information) Human Evaluation of Kea, an Automatic Keyphrasing System. Jones, Steve Paynter, Gordon W. Computer Interfaces Data Processing Electronic Libraries Information Retrieval Information Systems Keywords Man Machine Systems User Satisfaction (Information) Users (Information) This paper describes an evaluation of the Kea automatic keyphrase extraction algorithm. Tools that automatically identify keyphrases are desirable because document keyphrases have numerous applications in digital library systems, but are costly and time consuming to manually assign. Keyphrase extraction algorithms are usually evaluated by comparison to author-specified keywords, but this methodology has several well-known shortcomings. The results presented in this paper are based on subjective evaluations of the quality and appropriateness of keyphrases by human assessors, and make a number of contributions. First, they validate previous evaluations of Kea that rely on author keywords. Second, they show Kea's performance is comparable to that of similar systems that have been evaluated by human assessors. Finally, they justify the use of author keyphrases as a performance metric by showing that authors generally choose good keywords. (Contains 28 references.) (Author) |
| title | Human Evaluation of Kea, an Automatic Keyphrasing System. |
| topic | Computer Interfaces Data Processing Electronic Libraries Information Retrieval Information Systems Keywords Man Machine Systems User Satisfaction (Information) Users (Information) |
| url | https://eric.ed.gov/?id=ED459824 |