GitHub Proxy Server: A tool for supporting massive data collection on GitHub

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Borges, Hudson Silva, Valente, Marco Tulio
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910966571073536
author Borges, Hudson Silva
Valente, Marco Tulio
author_facet Borges, Hudson Silva
Valente, Marco Tulio
contents GitHub is the most popular social coding platform and widely used by developers and organizations to host their open-source projects around the world. Besides that, the platform has a web API that allow developers collect information from public repositories hosted on it. However, collecting massive amount of data from GitHub can be very challenging due to existing restrictions and abuse detection mechanisms. In this work, we present a tool, called GitHub Proxy Server, which abstracts such complexities into a tool that is independent on operational system and programming language. We show that, using the proposed tool, it is possible to improve the performance of GitHub mining tasks without any additional complexities.
format Preprint
id arxiv_https___arxiv_org_abs_2505_18305
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle GitHub Proxy Server: A tool for supporting massive data collection on GitHub
Borges, Hudson Silva
Valente, Marco Tulio
Software Engineering
GitHub is the most popular social coding platform and widely used by developers and organizations to host their open-source projects around the world. Besides that, the platform has a web API that allow developers collect information from public repositories hosted on it. However, collecting massive amount of data from GitHub can be very challenging due to existing restrictions and abuse detection mechanisms. In this work, we present a tool, called GitHub Proxy Server, which abstracts such complexities into a tool that is independent on operational system and programming language. We show that, using the proposed tool, it is possible to improve the performance of GitHub mining tasks without any additional complexities.
title GitHub Proxy Server: A tool for supporting massive data collection on GitHub
topic Software Engineering
url https://arxiv.org/abs/2505.18305