Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | https://arxiv.org/abs/2503.15571 |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912283831042048 |
|---|---|
| author | Thorat, Pankaj Qidwai, Adnan Dhar, Adrija Chakraborty, Aishwariya Eswaran, Anand Patel, Hima Jayachandran, Praveen |
| author_facet | Thorat, Pankaj Qidwai, Adnan Dhar, Adrija Chakraborty, Aishwariya Eswaran, Anand Patel, Hima Jayachandran, Praveen |
| contents | Data profiling is critical in machine learning for generating descriptive statistics, supporting both deeper understanding and downstream tasks like data valuation and curation. This work addresses profiling specifically in the context of code datasets for Large Language Models (code-LLMs), where data quality directly influences tasks such as code generation and summarization. Characterizing code datasets in terms of programming language concepts enables better insights and targeted data curation. Our proposed methodology decomposes code data profiling into two phases: (1) an offline phase where LLMs are leveraged to derive and learn rules for extracting syntactic and semantic concepts across various programming languages, including previously unseen or low-resource languages, and (2) an online deterministic phase applying these derived rules for efficient real-time analysis. This hybrid approach is customizable, extensible to new syntactic and semantic constructs, and scalable to multiple languages. Experimentally, our LLM-aided method achieves a mean accuracy of 90.33% for syntactic extraction rules and semantic classification accuracies averaging 80% and 77% across languages and semantic concepts, respectively. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_15571 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | LLM-Aided Customizable Profiling of Code Data Based On Programming Language Concepts Thorat, Pankaj Qidwai, Adnan Dhar, Adrija Chakraborty, Aishwariya Eswaran, Anand Patel, Hima Jayachandran, Praveen Software Engineering Emerging Technologies Information Retrieval Machine Learning Programming Languages Data profiling is critical in machine learning for generating descriptive statistics, supporting both deeper understanding and downstream tasks like data valuation and curation. This work addresses profiling specifically in the context of code datasets for Large Language Models (code-LLMs), where data quality directly influences tasks such as code generation and summarization. Characterizing code datasets in terms of programming language concepts enables better insights and targeted data curation. Our proposed methodology decomposes code data profiling into two phases: (1) an offline phase where LLMs are leveraged to derive and learn rules for extracting syntactic and semantic concepts across various programming languages, including previously unseen or low-resource languages, and (2) an online deterministic phase applying these derived rules for efficient real-time analysis. This hybrid approach is customizable, extensible to new syntactic and semantic constructs, and scalable to multiple languages. Experimentally, our LLM-aided method achieves a mean accuracy of 90.33% for syntactic extraction rules and semantic classification accuracies averaging 80% and 77% across languages and semantic concepts, respectively. |
| title | LLM-Aided Customizable Profiling of Code Data Based On Programming Language Concepts |
| topic | Software Engineering Emerging Technologies Information Retrieval Machine Learning Programming Languages |
| url | https://arxiv.org/abs/2503.15571 |