Cover Image

Fight Fire with Fire: How Much Can We Trust ChatGPT on Source Code-Related Tasks?

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yu, Xiao, Liu, Lei, Hu, Xing, Keung, Jacky Wai, Liu, Jin, Xia, Xin
Format:	Preprint
Published:	2024
Subjects:	Software Engineering
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Towards Understanding Bugs in Distributed Training and Inference Frameworks for Large Language Models
by: Yu, Xiao, et al.
Published: (2025)

Self-collaboration Code Generation via ChatGPT
by: Dong, Yihong, et al.
Published: (2023)

ChatGPT Inaccuracy Mitigation during Technical Report Understanding: Are We There Yet?
by: Tamanna, Salma Begum, et al.
Published: (2024)

When ChatGPT Meets Smart Contract Vulnerability Detection: How Far Are We?
by: Chen, Chong, et al.
Published: (2023)

An Empirical Study of Perceptions of General LLMs and Multimodal LLMs on Hugging Face
by: Liu, Yujian, et al.
Published: (2026)

Studying How Configurations Impact Code Generation in LLMs: the Case of ChatGPT
by: Donato, Benedetta, et al.
Published: (2025)

How to Refactor this Code? An Exploratory Study on Developer-ChatGPT Refactoring Conversations
by: AlOmar, Eman Abdullah, et al.
Published: (2024)

An Empirical Study of ChatGPT-Related Projects and Their Issues on GitHub
by: Lin, Zheng, et al.
Published: (2024)

Lightweight Model Editing for LLMs to Correct Deprecated API Recommendations
by: Lin, Guancheng, et al.
Published: (2025)

Why Do Developers Engage with ChatGPT in Issue-Tracker? Investigating Usage and Reliance on ChatGPT-Generated Code
by: Das, Joy Krishan, et al.
Published: (2024)

DevGPT: Studying Developer-ChatGPT Conversations
by: Xiao, Tao, et al.
Published: (2023)

Pros and Cons! Evaluating ChatGPT on Software Vulnerability
by: Yin, Xin
Published: (2024)

WildCode: An Empirical Analysis of Code Generated by ChatGPT
by: Khanmohammadi, Kobra, et al.
Published: (2025)

An Empirical Study of the Non-determinism of ChatGPT in Code Generation
by: Ouyang, Shuyin, et al.
Published: (2023)

No Need to Lift a Finger Anymore? Assessing the Quality of Code Generation by ChatGPT
by: Liu, Zhijie, et al.
Published: (2023)

How I Learned to Stop Worrying and Love ChatGPT
by: Przymus, Piotr, et al.
Published: (2025)

Evaluating and Improving ChatGPT-Based Expansion of Abbreviations
by: Jiang, Yanjie, et al.
Published: (2024)

Can OpenSource beat ChatGPT? -- A Comparative Study of Large Language Models for Text-to-Code Generation
by: Mayer, Luis, et al.
Published: (2024)

SysTradeBench: An Iterative Build-Test-Patch Benchmark for Strategy-to-Code Trading Systems with Drift-Aware Diagnostics
by: Cao, Yuchen, et al.
Published: (2026)

ChatGPT for Code Refactoring: Analyzing Topics, Interaction, and Effective Prompts
by: AlOmar, Eman Abdullah, et al.
Published: (2025)

Can ChatGPT Support Developers? An Empirical Evaluation of Large Language Models for Code Generation
by: Jin, Kailun, et al.
Published: (2024)

Where Is Self-admitted Code Generated by Large Language Models on GitHub?
by: Yu, Xiao, et al.
Published: (2024)

Exploring ChatGPT's Capabilities on Vulnerability Management
by: Liu, Peiyu, et al.
Published: (2023)

Is ChatGPT 3 safe for students?
by: Kotovich, Julia, et al.
Published: (2024)

Unveiling the Role of ChatGPT in Software Development: Insights from Developer-ChatGPT Interactions on GitHub
by: Li, Ruiyin, et al.
Published: (2025)

No More Manual Tests? Evaluating and Improving ChatGPT for Unit Test Generation
by: Yuan, Zhiqiang, et al.
Published: (2023)

Data Preparation for Deep Learning based Code Smell Detection: A Systematic Literature Review
by: Zhang, Fengji, et al.
Published: (2024)

How Can ChatGPT Support Human Security Testers to Help Mitigate Supply Chain Attacks?
by: Zhang, Ying, et al.
Published: (2023)

On the Possibility of Breaking Copyleft Licenses When Reusing Code Generated by ChatGPT
by: Colombo, Gaia, et al.
Published: (2025)

Prompt-Enhanced Software Vulnerability Detection Using ChatGPT
by: Zhang, Chenyuan, et al.
Published: (2023)

Unveiling ChatGPT's Usage in Open Source Projects: A Mining-based Study
by: Tufano, Rosalia, et al.
Published: (2024)

R2ComSync: Improving Code-Comment Synchronization with In-Context Learning and Reranking
by: Yang, Zhen, et al.
Published: (2025)

Delving into Parameter-Efficient Fine-Tuning in Code Change Learning: An Empirical Study
by: Liu, Shuo, et al.
Published: (2024)

Can ChatGPT support software verification?
by: Janßen, Christian, et al.
Published: (2023)

Exploring the Capabilities of LLMs for Code Change Related Tasks
by: Fan, Lishui, et al.
Published: (2024)

ChatGPT: Friend or Foe When Comprehending and Changing Unfamiliar Code
by: Anderson, Norman, et al.
Published: (2026)

Enhancing Android Malware Detection: The Influence of ChatGPT on Decision-centric Task
by: Li, Yao, et al.
Published: (2024)

Beyond ChatGPT: Enhancing Software Quality Assurance Tasks with Diverse LLMs and Validation Techniques
by: Widyasari, Ratnadira, et al.
Published: (2024)

Experimental Analysis of Productive Interaction Strategy with ChatGPT: User Study on Function and Project-level Code Generation Tasks
by: Hyun, Sangwon, et al.
Published: (2025)

The role of library versions in Developer-ChatGPT conversations
by: Raj, Rachna, et al.
Published: (2024)