KGLiDS: A Platform for Semantic Abstraction, Linking, and Automation of Data Science
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916283235172352 |
|---|---|
| author | Helali, Mossad Monjazeb, Niki Vashisth, Shubham Carrier, Philippe Helal, Ahmed Cavalcante, Antonio Ammar, Khaled Hose, Katja Mansour, Essam |
| author_facet | Helali, Mossad Monjazeb, Niki Vashisth, Shubham Carrier, Philippe Helal, Ahmed Cavalcante, Antonio Ammar, Khaled Hose, Katja Mansour, Essam |
| contents | In recent years, we have witnessed the growing interest from academia and industry in applying data science technologies to analyze large amounts of data. In this process, a myriad of artifacts (datasets, pipeline scripts, etc.) are created. However, there has been no systematic attempt to holistically collect and exploit all the knowledge and experiences that are implicitly contained in those artifacts. Instead, data scientists recover information and expertise from colleagues or learn via trial and error. Hence, this paper presents a scalable platform, KGLiDS, that employs machine learning and knowledge graph technologies to abstract and capture the semantics of data science artifacts and their connections. Based on this information, KGLiDS enables various downstream applications, such as data discovery and pipeline automation. Our comprehensive evaluation covers use cases in data discovery, data cleaning, transformation, and AutoML. It shows that KGLiDS is significantly faster with a lower memory footprint than the state-of-the-art systems while achieving comparable or better accuracy. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2303_02204 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | KGLiDS: A Platform for Semantic Abstraction, Linking, and Automation of Data Science Helali, Mossad Monjazeb, Niki Vashisth, Shubham Carrier, Philippe Helal, Ahmed Cavalcante, Antonio Ammar, Khaled Hose, Katja Mansour, Essam Machine Learning In recent years, we have witnessed the growing interest from academia and industry in applying data science technologies to analyze large amounts of data. In this process, a myriad of artifacts (datasets, pipeline scripts, etc.) are created. However, there has been no systematic attempt to holistically collect and exploit all the knowledge and experiences that are implicitly contained in those artifacts. Instead, data scientists recover information and expertise from colleagues or learn via trial and error. Hence, this paper presents a scalable platform, KGLiDS, that employs machine learning and knowledge graph technologies to abstract and capture the semantics of data science artifacts and their connections. Based on this information, KGLiDS enables various downstream applications, such as data discovery and pipeline automation. Our comprehensive evaluation covers use cases in data discovery, data cleaning, transformation, and AutoML. It shows that KGLiDS is significantly faster with a lower memory footprint than the state-of-the-art systems while achieving comparable or better accuracy. |
| title | KGLiDS: A Platform for Semantic Abstraction, Linking, and Automation of Data Science |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2303.02204 |