Can Small GenAI Language Models Rival Large Language Models in Understanding Application Behavior?
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866914160234725376 |
|---|---|
| author | Meymani, Mohammad Jelodar, Hamed Hamedi, Parisa Razavi-Far, Roozbeh Ghorbani, Ali A. |
| author_facet | Meymani, Mohammad Jelodar, Hamed Hamedi, Parisa Razavi-Far, Roozbeh Ghorbani, Ali A. |
| contents | Generative AI (GenAI) models, particularly large language models (LLMs), have transformed multiple domains, including natural language processing, software analysis, and code understanding. Their ability to analyze and generate code has enabled applications such as source code summarization, behavior analysis, and malware detection. In this study, we systematically evaluate the capabilities of both small and large GenAI language models in understanding application behavior, with a particular focus on malware detection as a representative task. While larger models generally achieve higher overall accuracy, our experiments show that small GenAI models maintain competitive precision and recall, offering substantial advantages in computational efficiency, faster inference, and deployment in resource-constrained environments. We provide a detailed comparison across metrics such as accuracy, precision, recall, and F1-score, highlighting each model's strengths, limitations, and operational feasibility. Our findings demonstrate that small GenAI models can effectively complement large ones, providing a practical balance between performance and resource efficiency in real-world application behavior analysis. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_12576 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Can Small GenAI Language Models Rival Large Language Models in Understanding Application Behavior? Meymani, Mohammad Jelodar, Hamed Hamedi, Parisa Razavi-Far, Roozbeh Ghorbani, Ali A. Software Engineering Generative AI (GenAI) models, particularly large language models (LLMs), have transformed multiple domains, including natural language processing, software analysis, and code understanding. Their ability to analyze and generate code has enabled applications such as source code summarization, behavior analysis, and malware detection. In this study, we systematically evaluate the capabilities of both small and large GenAI language models in understanding application behavior, with a particular focus on malware detection as a representative task. While larger models generally achieve higher overall accuracy, our experiments show that small GenAI models maintain competitive precision and recall, offering substantial advantages in computational efficiency, faster inference, and deployment in resource-constrained environments. We provide a detailed comparison across metrics such as accuracy, precision, recall, and F1-score, highlighting each model's strengths, limitations, and operational feasibility. Our findings demonstrate that small GenAI models can effectively complement large ones, providing a practical balance between performance and resource efficiency in real-world application behavior analysis. |
| title | Can Small GenAI Language Models Rival Large Language Models in Understanding Application Behavior? |
| topic | Software Engineering |
| url | https://arxiv.org/abs/2511.12576 |