Beyond Advocacy: A Design Space for Replication-Related Studies
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913084174499840 |
|---|---|
| author | Liang, Yiheng Marriott, Kim Purchase, Helen C. |
| author_facet | Liang, Yiheng Marriott, Kim Purchase, Helen C. |
| contents | The importance of replication is often discussed and advocated -- not only in the domains of visualization and HCI, but in all scientific areas. When replicating a study, design decisions need to be made with regards which aspects of the original study will remain the same and which will be altered. We present a supporting multi-dimensional design space framework within which such decisions can be identified, categorized, compared and analyzed. The framework treats replication experimental design as a pairwise comparison problem, and represents the design by four practical dimensions defined by three comparison levels. The design space is therefore a framework that can be used for both retrospective characterization and prospective planning. We provide worked examples, and relate our framework to other attempts at describing the scope of replication studies. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_04959 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Beyond Advocacy: A Design Space for Replication-Related Studies Liang, Yiheng Marriott, Kim Purchase, Helen C. Human-Computer Interaction The importance of replication is often discussed and advocated -- not only in the domains of visualization and HCI, but in all scientific areas. When replicating a study, design decisions need to be made with regards which aspects of the original study will remain the same and which will be altered. We present a supporting multi-dimensional design space framework within which such decisions can be identified, categorized, compared and analyzed. The framework treats replication experimental design as a pairwise comparison problem, and represents the design by four practical dimensions defined by three comparison levels. The design space is therefore a framework that can be used for both retrospective characterization and prospective planning. We provide worked examples, and relate our framework to other attempts at describing the scope of replication studies. |
| title | Beyond Advocacy: A Design Space for Replication-Related Studies |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2603.04959 |