Analyzing Two Automatic Latent Semantic Analysis (LSA) Assessment Methods (Inbuilt Rubric vs. Golden Summary) in Summaries Extracted from Expository Texts
Fuente:
Redalyc
Saved in:
| Main Author: | |
|---|---|
| Format: | Artículo científico |
| Language: | en |
| Published: |
Colegio Oficial de Psicólogos de Madrid
2018
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1876448816055451648 |
|---|---|
| author | José Ángel Martínez-Huertas |
| author_facet | José Ángel Martínez-Huertas |
| contents | Analyzing Two Automatic Latent Semantic Analysis (LSA) Assessment Methods (Inbuilt Rubric vs. Golden Summary) in Summaries Extracted from Expository Texts José Ángel Martínez-Huertas Olga Jastrzebska Adrián Mencu Jessica Moraleda Ricardo Olmos José Antonio León Psicología LSA Summaries Inbuilt rubric Lexical descriptors Automatic essay scoring (AES) The purpose of this study was to compare two automatic assessment methods using Latent Semantic Analysis (LSA): a novel LSA assessment method (Inbuilt Rubric) and a traditional LSA method (Golden Summary). Two conditions were analyzed using the Inbuilt Rubric method: the number of lexical descriptors needed to better accommodate an expert rubric (few vs. many) and a weighting function to penalize off-topic contents included in the student summaries (weighted vs. non-weighted). One hundred and sixty-six students divided in two different samples (81 undergraduates and 85 High School students) took part in this study. Students summarized two expository texts that differed in complexity (complex/easy) and length (1,300/500 words). Results showed that the Inbuilt Rubric method simulates human assessment better than Golden summaries in all cases. The similarity with human assessment was higher for Inbuilt Rubric (r = .78 and r = .79) than for Golden Summary (r = .67 and r = .47) in both texts. Moreover, to accommodate an expert rubric into the Inbuilt Rubric method was better using few descriptors and the weighted function. 2018 artículo científico 1135-755X https://www.redalyc.org/articulo.oa?id=613769979005 https://www.redalyc.org/journal/6137/613769979005/ https://www.redalyc.org/journal/6137/613769979005/html/ https://www.redalyc.org/journal/6137/613769979005/613769979005.epub https://www.redalyc.org/journal/6137/613769979005/movil 10.5093/psed2048a9 en http://www.redalyc.org/revista.oa?id=6137 Psicología Educativa. Revista de los Psicólogos de la Educación application/pdf Colegio Oficial de Psicólogos de Madrid Psicología Educativa. Revista de los Psicólogos de la Educación (España) Num.2 Vol.24 |
| format | Artículo científico |
| id | redalyc_613769979005 |
| institution | Redalyc |
| language | en |
| publishDate | 2018 |
| publisher | Colegio Oficial de Psicólogos de Madrid |
| spellingShingle | Analyzing Two Automatic Latent Semantic Analysis (LSA) Assessment Methods (Inbuilt Rubric vs. Golden Summary) in Summaries Extracted from Expository Texts José Ángel Martínez-Huertas Psicología LSA Summaries Inbuilt rubric Lexical descriptors Automatic essay scoring (AES) Analyzing Two Automatic Latent Semantic Analysis (LSA) Assessment Methods (Inbuilt Rubric vs. Golden Summary) in Summaries Extracted from Expository Texts José Ángel Martínez-Huertas Olga Jastrzebska Adrián Mencu Jessica Moraleda Ricardo Olmos José Antonio León Psicología LSA Summaries Inbuilt rubric Lexical descriptors Automatic essay scoring (AES) The purpose of this study was to compare two automatic assessment methods using Latent Semantic Analysis (LSA): a novel LSA assessment method (Inbuilt Rubric) and a traditional LSA method (Golden Summary). Two conditions were analyzed using the Inbuilt Rubric method: the number of lexical descriptors needed to better accommodate an expert rubric (few vs. many) and a weighting function to penalize off-topic contents included in the student summaries (weighted vs. non-weighted). One hundred and sixty-six students divided in two different samples (81 undergraduates and 85 High School students) took part in this study. Students summarized two expository texts that differed in complexity (complex/easy) and length (1,300/500 words). Results showed that the Inbuilt Rubric method simulates human assessment better than Golden summaries in all cases. The similarity with human assessment was higher for Inbuilt Rubric (r = .78 and r = .79) than for Golden Summary (r = .67 and r = .47) in both texts. Moreover, to accommodate an expert rubric into the Inbuilt Rubric method was better using few descriptors and the weighted function. 2018 artículo científico 1135-755X https://www.redalyc.org/articulo.oa?id=613769979005 https://www.redalyc.org/journal/6137/613769979005/ https://www.redalyc.org/journal/6137/613769979005/html/ https://www.redalyc.org/journal/6137/613769979005/613769979005.epub https://www.redalyc.org/journal/6137/613769979005/movil 10.5093/psed2048a9 en http://www.redalyc.org/revista.oa?id=6137 Psicología Educativa. Revista de los Psicólogos de la Educación application/pdf Colegio Oficial de Psicólogos de Madrid Psicología Educativa. Revista de los Psicólogos de la Educación (España) Num.2 Vol.24 |
| title | Analyzing Two Automatic Latent Semantic Analysis (LSA) Assessment Methods (Inbuilt Rubric vs. Golden Summary) in Summaries Extracted from Expository Texts |
| topic | Psicología LSA Summaries Inbuilt rubric Lexical descriptors Automatic essay scoring (AES) |
| url | https://www.redalyc.org/articulo.oa?id=613769979005 https://www.redalyc.org/journal/6137/613769979005/ https://www.redalyc.org/journal/6137/613769979005/html/ https://www.redalyc.org/journal/6137/613769979005/613769979005.epub https://www.redalyc.org/journal/6137/613769979005/movil |