ChatGPT's Potential in Cryptography Misuse Detection: A Comparative Analysis with Static Analysis Tools
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912021078867968 |
|---|---|
| author | Firouzi, Ehsan Ghafari, Mohammad Ebrahimi, Mike |
| author_facet | Firouzi, Ehsan Ghafari, Mohammad Ebrahimi, Mike |
| contents | The correct adoption of cryptography APIs is challenging for mainstream developers, often resulting in widespread API misuse. Meanwhile, cryptography misuse detectors have demonstrated inconsistent performance and remain largely inaccessible to most developers. We investigated the extent to which ChatGPT can detect cryptography misuses and compared its performance with that of the state-of-the-art static analysis tools. Our investigation, mainly based on the CryptoAPI-Bench benchmark, demonstrated that ChatGPT is effective in identifying cryptography API misuses, and with the use of prompt engineering, it can even outperform leading static cryptography misuse detectors. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_06561 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | ChatGPT's Potential in Cryptography Misuse Detection: A Comparative Analysis with Static Analysis Tools Firouzi, Ehsan Ghafari, Mohammad Ebrahimi, Mike Cryptography and Security Artificial Intelligence The correct adoption of cryptography APIs is challenging for mainstream developers, often resulting in widespread API misuse. Meanwhile, cryptography misuse detectors have demonstrated inconsistent performance and remain largely inaccessible to most developers. We investigated the extent to which ChatGPT can detect cryptography misuses and compared its performance with that of the state-of-the-art static analysis tools. Our investigation, mainly based on the CryptoAPI-Bench benchmark, demonstrated that ChatGPT is effective in identifying cryptography API misuses, and with the use of prompt engineering, it can even outperform leading static cryptography misuse detectors. |
| title | ChatGPT's Potential in Cryptography Misuse Detection: A Comparative Analysis with Static Analysis Tools |
| topic | Cryptography and Security Artificial Intelligence |
| url | https://arxiv.org/abs/2409.06561 |