Evaluating the Performance and Efficiency of Sentence-BERT for Code Comment Classification
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913891587457024 |
|---|---|
| author | Peña, Fabian C. Herbold, Steffen |
| author_facet | Peña, Fabian C. Herbold, Steffen |
| contents | This work evaluates Sentence-BERT for a multi-label code comment classification task seeking to maximize the classification performance while controlling efficiency constraints during inference. Using a dataset of 13,216 labeled comment sentences, Sentence-BERT models are fine-tuned and combined with different classification heads to recognize comment types. While larger models outperform smaller ones in terms of F1, the latter offer outstanding efficiency, both in runtime and GFLOPS. As result, a balance between a reasonable F1 improvement (+0.0346) and a minimal efficiency degradation (+1.4x in runtime and +2.1x in GFLOPS) is reached. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_08581 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Evaluating the Performance and Efficiency of Sentence-BERT for Code Comment Classification Peña, Fabian C. Herbold, Steffen Software Engineering This work evaluates Sentence-BERT for a multi-label code comment classification task seeking to maximize the classification performance while controlling efficiency constraints during inference. Using a dataset of 13,216 labeled comment sentences, Sentence-BERT models are fine-tuned and combined with different classification heads to recognize comment types. While larger models outperform smaller ones in terms of F1, the latter offer outstanding efficiency, both in runtime and GFLOPS. As result, a balance between a reasonable F1 improvement (+0.0346) and a minimal efficiency degradation (+1.4x in runtime and +2.1x in GFLOPS) is reached. |
| title | Evaluating the Performance and Efficiency of Sentence-BERT for Code Comment Classification |
| topic | Software Engineering |
| url | https://arxiv.org/abs/2506.08581 |