Dynamic Benchmarking of Reasoning Capabilities in Code Large Language Models Under Data Contamination

Documenti analoghi

• SemCoder: Training Code Language Models with Comprehensive Semantics Reasoning
  di: Ding, Yangruibo, et al.
  Pubblicazione: (2024)
• CodeSense: a Real-World Benchmark and Dataset for Code Semantic Reasoning
  di: Roy, Monoshi Kumar, et al.
  Pubblicazione: (2025)
• CodeMind: Evaluating Large Language Models for Code Reasoning
  di: Liu, Changshu, et al.
  Pubblicazione: (2024)
• A Code Comprehension Benchmark for Large Language Models for Code
  di: Havare, Jayant, et al.
  Pubblicazione: (2025)
• PPM: Automated Generation of Diverse Programming Problems for Benchmarking Code Generation Models
  di: Chen, Simin, et al.
  Pubblicazione: (2024)