ConvScale: Conversational Interviews for Scale-Aligned Measurement
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910050592751616 |
|---|---|
| author | Qin, Peinuan Chen, Jingzhu Yang, Yitian Meng, Han Zhu, Zicheng Lee, Yi-Chieh |
| author_facet | Qin, Peinuan Chen, Jingzhu Yang, Yitian Meng, Han Zhu, Zicheng Lee, Yi-Chieh |
| contents | Conversational interviews are commonly used to complement structured surveys by eliciting rich and contextualized responses, which are typically analyzed qualitatively. However, their potential contribution to quantitative measurement remains underexplored. In this paper, we introduce ConvScale, an AI-supported approach that transforms psychometric scales into natural conversational interviews while preserving the original measurement structure. Based on interview data, ConvScale predicts item-level scores and aggregates them to derive scale-based assessments. In a within-subjects study with 18 participants, our results show that ConvScale-derived scores align closely with participants' self-report scores at both the item and construct levels, while maintaining moderate internal reliability; however, the structural validity was inadequate. In light of this, we discussed the potential of supporting quantitative measurement through interviews and proposed implications for future designs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_11988 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | ConvScale: Conversational Interviews for Scale-Aligned Measurement Qin, Peinuan Chen, Jingzhu Yang, Yitian Meng, Han Zhu, Zicheng Lee, Yi-Chieh Human-Computer Interaction Conversational interviews are commonly used to complement structured surveys by eliciting rich and contextualized responses, which are typically analyzed qualitatively. However, their potential contribution to quantitative measurement remains underexplored. In this paper, we introduce ConvScale, an AI-supported approach that transforms psychometric scales into natural conversational interviews while preserving the original measurement structure. Based on interview data, ConvScale predicts item-level scores and aggregates them to derive scale-based assessments. In a within-subjects study with 18 participants, our results show that ConvScale-derived scores align closely with participants' self-report scores at both the item and construct levels, while maintaining moderate internal reliability; however, the structural validity was inadequate. In light of this, we discussed the potential of supporting quantitative measurement through interviews and proposed implications for future designs. |
| title | ConvScale: Conversational Interviews for Scale-Aligned Measurement |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2603.11988 |