A simulation study of rater agreement measures with 2x2 contingency tables
Fuente:
Redalyc
Enregistré dans:
| Auteur principal: | |
|---|---|
| Format: | Artículo científico |
| Langue: | en |
| Publié: |
Universitat de València
2011
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1876481804536381440 |
|---|---|
| author | Manuel Ato |
| author_facet | Manuel Ato |
| contents | A simulation study of rater agreement measures with 2x2 contingency tables Manuel Ato Juan José López Ana Benavente Psicología A comparison between six rater agreement measures obtained using three different approaches was achieved by means of a simulation study. Rater coefficients suggested by Bennet's sigma (1954), Scott's Pi (1955), Cohen's kappa(1960) and Gwet's gamma (2008) were selected to represent the classical, descriptive approach, ¿¿ agreement parameter from Aickin (1990) to represent loglinear and mixture model approaches and delta measure from Martin and Femia (2004) to represent multiple-choice test. Main results confirm that Pi and kappa descriptive measures present high levels of mean bias in presence of extreme values of prevalence and rater bias but small to null levels with moderate values. The best behavior was observed with Bennet and Martin and Femia agreement measures for all levels of prevalence. 2011 artículo científico 0211-2159 https://www.redalyc.org/articulo.oa?id=16920109012 en http://www.redalyc.org/revista.oa?id=169 Psicológica application/pdf Universitat de València Psicológica (España) Num.2 Vol.32 |
| format | Artículo científico |
| id | redalyc_16920109012 |
| institution | Redalyc |
| language | en |
| publishDate | 2011 |
| publisher | Universitat de València |
| spellingShingle | A simulation study of rater agreement measures with 2x2 contingency tables Manuel Ato Psicología A simulation study of rater agreement measures with 2x2 contingency tables Manuel Ato Juan José López Ana Benavente Psicología A comparison between six rater agreement measures obtained using three different approaches was achieved by means of a simulation study. Rater coefficients suggested by Bennet's sigma (1954), Scott's Pi (1955), Cohen's kappa(1960) and Gwet's gamma (2008) were selected to represent the classical, descriptive approach, ¿¿ agreement parameter from Aickin (1990) to represent loglinear and mixture model approaches and delta measure from Martin and Femia (2004) to represent multiple-choice test. Main results confirm that Pi and kappa descriptive measures present high levels of mean bias in presence of extreme values of prevalence and rater bias but small to null levels with moderate values. The best behavior was observed with Bennet and Martin and Femia agreement measures for all levels of prevalence. 2011 artículo científico 0211-2159 https://www.redalyc.org/articulo.oa?id=16920109012 en http://www.redalyc.org/revista.oa?id=169 Psicológica application/pdf Universitat de València Psicológica (España) Num.2 Vol.32 |
| title | A simulation study of rater agreement measures with 2x2 contingency tables |
| topic | Psicología |
| url | https://www.redalyc.org/articulo.oa?id=16920109012 |