Understanding Documentation Use Through Log Analysis: An Exploratory Case Study of Four Cloud Services

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Nam, Daye, Macvean, Andrew, Myers, Brad, Vasilescu, Bogdan
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911786669703168
author Nam, Daye
Macvean, Andrew
Myers, Brad
Vasilescu, Bogdan
author_facet Nam, Daye
Macvean, Andrew
Myers, Brad
Vasilescu, Bogdan
contents Almost no modern software system is written from scratch, and developers are required to effectively learn to use third-party libraries or software services. Thus, many practitioners and researchers have looked for ways to create effective documentation that supports developers' learning. However, few efforts have focused on how people actually use the documentation. In this paper, we report on an exploratory, multi-phase, mixed methods empirical study of documentation page-view logs from four cloud-based industrial services. By analyzing page-view logs for over 100,000 users, we find diverse patterns of documentation page visits. Moreover, we show statistically that which documentation pages people visit often correlates with user characteristics such as past experience with the specific product, on the one hand, and with future adoption of the API on the other hand. We discuss the implications of these results on documentation design and propose documentation page-view log analysis as a feasible technique for design audits of documentation, from ones written for software developers to ones designed to support end users (e.g., Adobe Photoshop).
format Preprint
id arxiv_https___arxiv_org_abs_2310_10817
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Understanding Documentation Use Through Log Analysis: An Exploratory Case Study of Four Cloud Services
Nam, Daye
Macvean, Andrew
Myers, Brad
Vasilescu, Bogdan
Software Engineering
Human-Computer Interaction
Almost no modern software system is written from scratch, and developers are required to effectively learn to use third-party libraries or software services. Thus, many practitioners and researchers have looked for ways to create effective documentation that supports developers' learning. However, few efforts have focused on how people actually use the documentation. In this paper, we report on an exploratory, multi-phase, mixed methods empirical study of documentation page-view logs from four cloud-based industrial services. By analyzing page-view logs for over 100,000 users, we find diverse patterns of documentation page visits. Moreover, we show statistically that which documentation pages people visit often correlates with user characteristics such as past experience with the specific product, on the one hand, and with future adoption of the API on the other hand. We discuss the implications of these results on documentation design and propose documentation page-view log analysis as a feasible technique for design audits of documentation, from ones written for software developers to ones designed to support end users (e.g., Adobe Photoshop).
title Understanding Documentation Use Through Log Analysis: An Exploratory Case Study of Four Cloud Services
topic Software Engineering
Human-Computer Interaction
url https://arxiv.org/abs/2310.10817