Saved in:
| Main Author: | |
|---|---|
| Format: | Recurso educativo Open Access |
| Language: | en |
| Published: |
1968
|
| Subjects: | |
| Online Access: | https://eric.ed.gov/?id=ED027921 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1867181718486646784 |
|---|---|
| author | Cuadra, Carlos A. |
| author_facet | Cuadra, Carlos A. Cuadra, Carlos A. |
| collection | Education Resources Information Center |
| contents | A Study of Relevance Judgments. Cuadra, Carlos A. Evaluation Methods Information Science Information Systems Relevance (Information Retrieval) Systems Analysis During the two-year Relevance Assessment Project, 15 studies were designed and carried out with over 500 subjects used as relevance judges. The subjects were librarians, information specialists, library science students and faculty, and graduate and upper division students in psychology. Materials for judging were selected for subjects according to their interests and backgrounds. Results of the many experiments conducted indicate that relevance judgments can be influenced by many factors including (1) the skills and attitudes of the judges used, (2) the documents and document sets used, (3) the particular information requirement statements, (4) the instructions and setting in which the judgments take place, (5) the concepts and definitions of relevance employed in the judgments, and (6) the type of rating scale or other instrument used to express the judgments. Findings indicate that relevance scores must be used with caution for system evaluation. A list of articles and reports on the project is included. (CC) |
| format | Recurso educativo Open Access |
| id | eric_ED027921 |
| institution | ERIC Institute of Education Sciences |
| language | en |
| publishDate | 1968 |
| record_format | eric |
| spellingShingle | A Study of Relevance Judgments. Cuadra, Carlos A. Evaluation Methods Information Science Information Systems Relevance (Information Retrieval) Systems Analysis A Study of Relevance Judgments. Cuadra, Carlos A. Evaluation Methods Information Science Information Systems Relevance (Information Retrieval) Systems Analysis During the two-year Relevance Assessment Project, 15 studies were designed and carried out with over 500 subjects used as relevance judges. The subjects were librarians, information specialists, library science students and faculty, and graduate and upper division students in psychology. Materials for judging were selected for subjects according to their interests and backgrounds. Results of the many experiments conducted indicate that relevance judgments can be influenced by many factors including (1) the skills and attitudes of the judges used, (2) the documents and document sets used, (3) the particular information requirement statements, (4) the instructions and setting in which the judgments take place, (5) the concepts and definitions of relevance employed in the judgments, and (6) the type of rating scale or other instrument used to express the judgments. Findings indicate that relevance scores must be used with caution for system evaluation. A list of articles and reports on the project is included. (CC) |
| title | A Study of Relevance Judgments. |
| topic | Evaluation Methods Information Science Information Systems Relevance (Information Retrieval) Systems Analysis |
| url | https://eric.ed.gov/?id=ED027921 |