Evaluating recognition and recall formats of social network surveys in physics education research
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917501399465984 |
|---|---|
| author | Sundstrom, Meagan Gambrell, Justin Traxler, Adrienne L. Brewe, Eric |
| author_facet | Sundstrom, Meagan Gambrell, Justin Traxler, Adrienne L. Brewe, Eric |
| contents | An increasing number of studies in physics education research use social network analysis to quantify interactions among students. These studies typically gather data through online surveys using one of two different survey formats: recognition, where students select peers' names from a provided course roster, and recall, where students type their peers' names from memory as an open response. These survey formats, however, may be subject to two possible systematic errors. First, students may report more peers' names on a recognition survey than a recall survey because the course roster facilitates their memory of their interactions, whereas they may only remember a subset of their interactions on the recall format. Second, recognition surveys may be subject to name order effects, where students are more likely to select peers' names that appear early on in the roster than those that appear later on (e.g., due to survey fatigue). Here we report the results of two methodological studies of these possible errors in the context of introductory physics courses: one directly comparing 65 student responses to recognition and recall versions of the same network survey prompt, and the other measuring name order effects on 54 recognition surveys from 27 different courses. We find that students may report more peer interactions on a recognition survey than a recall survey and that most recognition surveys are not subject to significant name order effects. These results help to inform survey design for future network studies in physics education research. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_08417 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Evaluating recognition and recall formats of social network surveys in physics education research Sundstrom, Meagan Gambrell, Justin Traxler, Adrienne L. Brewe, Eric Physics Education An increasing number of studies in physics education research use social network analysis to quantify interactions among students. These studies typically gather data through online surveys using one of two different survey formats: recognition, where students select peers' names from a provided course roster, and recall, where students type their peers' names from memory as an open response. These survey formats, however, may be subject to two possible systematic errors. First, students may report more peers' names on a recognition survey than a recall survey because the course roster facilitates their memory of their interactions, whereas they may only remember a subset of their interactions on the recall format. Second, recognition surveys may be subject to name order effects, where students are more likely to select peers' names that appear early on in the roster than those that appear later on (e.g., due to survey fatigue). Here we report the results of two methodological studies of these possible errors in the context of introductory physics courses: one directly comparing 65 student responses to recognition and recall versions of the same network survey prompt, and the other measuring name order effects on 54 recognition surveys from 27 different courses. We find that students may report more peer interactions on a recognition survey than a recall survey and that most recognition surveys are not subject to significant name order effects. These results help to inform survey design for future network studies in physics education research. |
| title | Evaluating recognition and recall formats of social network surveys in physics education research |
| topic | Physics Education |
| url | https://arxiv.org/abs/2508.08417 |