SocialX: A Modular Platform for Multi-Source Big Data Research in Indonesia
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866912985019056128 |
|---|---|
| author | Saputra, Muhammad Apriandito Arya Alamsyah, Andry Ramadhani, Dian Puteri Siadari, Thomhert Suprapto Fakhrurroja, Hanif |
| author_facet | Saputra, Muhammad Apriandito Arya Alamsyah, Andry Ramadhani, Dian Puteri Siadari, Thomhert Suprapto Fakhrurroja, Hanif |
| contents | Big data research in Indonesia is constrained by a fundamental fragmentation: relevant data is scattered across social media, news portals, e-commerce platforms, review sites, and academic databases, each with different formats, access methods, and noise characteristics. Researchers must independently build collection pipelines, clean heterogeneous data, and assemble separate analysis tools, a process that often overshadows the research itself. We present SocialX, a modular platform for multi-source big data research that integrates heterogeneous data collection, language-aware preprocessing, and pluggable analysis into a unified, source-agnostic pipeline. The platform separates concerns into three independent layers (collection, preprocessing, and analysis) connected by a lightweight job-coordination mechanism. This modularity allows each layer to grow independently: new data sources, preprocessing methods, or analysis tools can be added without modifying the existing pipeline. We describe the design principles that enable this extensibility, detail the preprocessing methodology that addresses challenges specific to Indonesian text across registers, and demonstrate the platform's utility through a walkthrough of a typical research workflow. SocialX is publicly accessible as a web-based platform at https://www.socialx.id. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_26253 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | SocialX: A Modular Platform for Multi-Source Big Data Research in Indonesia Saputra, Muhammad Apriandito Arya Alamsyah, Andry Ramadhani, Dian Puteri Siadari, Thomhert Suprapto Fakhrurroja, Hanif Computation and Language 68N30, 68T50 D.2.11; I.2.7 Big data research in Indonesia is constrained by a fundamental fragmentation: relevant data is scattered across social media, news portals, e-commerce platforms, review sites, and academic databases, each with different formats, access methods, and noise characteristics. Researchers must independently build collection pipelines, clean heterogeneous data, and assemble separate analysis tools, a process that often overshadows the research itself. We present SocialX, a modular platform for multi-source big data research that integrates heterogeneous data collection, language-aware preprocessing, and pluggable analysis into a unified, source-agnostic pipeline. The platform separates concerns into three independent layers (collection, preprocessing, and analysis) connected by a lightweight job-coordination mechanism. This modularity allows each layer to grow independently: new data sources, preprocessing methods, or analysis tools can be added without modifying the existing pipeline. We describe the design principles that enable this extensibility, detail the preprocessing methodology that addresses challenges specific to Indonesian text across registers, and demonstrate the platform's utility through a walkthrough of a typical research workflow. SocialX is publicly accessible as a web-based platform at https://www.socialx.id. |
| title | SocialX: A Modular Platform for Multi-Source Big Data Research in Indonesia |
| topic | Computation and Language 68N30, 68T50 D.2.11; I.2.7 |
| url | https://arxiv.org/abs/2603.26253 |