Measuring Software Innovation with Open Source Software Development Data

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Brown, Eva Maxfield, Osborne, Cailean, Cihon, Peter, Böhmecke-Schwafert, Moritz, Xu, Kevin, Boehm, Mirko, Blind, Knut
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916816319676416
author Brown, Eva Maxfield
Osborne, Cailean
Cihon, Peter
Böhmecke-Schwafert, Moritz
Xu, Kevin
Boehm, Mirko
Blind, Knut
author_facet Brown, Eva Maxfield
Osborne, Cailean
Cihon, Peter
Böhmecke-Schwafert, Moritz
Xu, Kevin
Boehm, Mirko
Blind, Knut
contents Existing innovation metrics inadequately capture software innovation, creating blind spots for researchers and policymakers seeking to understand and foster technological innovation in an increasingly software-defined economy. This paper introduces a novel measure of software innovation based on open source software (OSS) development activity on GitHub. We examine the dependency growth and release complexity among 350,000 unique releases from 33,000 unique packages across the JavaScript, Python, and Ruby ecosystems over two years post-release. We find that the semantic versioning types of OSS releases exhibit ecosystem-specific and maturity-dependent patterns in predicting one-year dependency growth, with minor releases showing relatively consistent adoption across contexts while major and patch releases vary significantly by ecosystem and package size. In addition, while semantic versioning correlates with the technical complexity of the change-set, complexity itself shows minimal correlation with downstream adoption, suggesting that versioning signals rather than technical change drive dependency growth. Overall, while semantic versioning release information can be used as a unit of innovation in OSS development complementary to common sources for innovation metrics (e.g. scientific publications, patents, and standards), this measure should be weighted by ecosystem culture, package maturity, and release type to accurately capture innovation dynamics. We conclude with a discussion of the theoretical and practical implications of this novel measure of software innovation as well as future research directions.
format Preprint
id arxiv_https___arxiv_org_abs_2411_05087
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Measuring Software Innovation with Open Source Software Development Data
Brown, Eva Maxfield
Osborne, Cailean
Cihon, Peter
Böhmecke-Schwafert, Moritz
Xu, Kevin
Boehm, Mirko
Blind, Knut
Software Engineering
Existing innovation metrics inadequately capture software innovation, creating blind spots for researchers and policymakers seeking to understand and foster technological innovation in an increasingly software-defined economy. This paper introduces a novel measure of software innovation based on open source software (OSS) development activity on GitHub. We examine the dependency growth and release complexity among 350,000 unique releases from 33,000 unique packages across the JavaScript, Python, and Ruby ecosystems over two years post-release. We find that the semantic versioning types of OSS releases exhibit ecosystem-specific and maturity-dependent patterns in predicting one-year dependency growth, with minor releases showing relatively consistent adoption across contexts while major and patch releases vary significantly by ecosystem and package size. In addition, while semantic versioning correlates with the technical complexity of the change-set, complexity itself shows minimal correlation with downstream adoption, suggesting that versioning signals rather than technical change drive dependency growth. Overall, while semantic versioning release information can be used as a unit of innovation in OSS development complementary to common sources for innovation metrics (e.g. scientific publications, patents, and standards), this measure should be weighted by ecosystem culture, package maturity, and release type to accurately capture innovation dynamics. We conclude with a discussion of the theoretical and practical implications of this novel measure of software innovation as well as future research directions.
title Measuring Software Innovation with Open Source Software Development Data
topic Software Engineering
url https://arxiv.org/abs/2411.05087