Cover Image

SolContractEval: A Benchmark for Evaluating Contract-Level Solidity Code Generation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ye, Zhifan, Chen, Jiachi, Shao, Zhenzhe, Bao, Lingfeng, Yang, Xiaohu, Liu, Zhongxin
Format:	Preprint
Published:	2025
Subjects:	Software Engineering
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

NumScout: Unveiling Numerical Defects in Smart Contracts using LLM-Pruning Symbolic Execution
by: Chen, Jiachi, et al.
Published: (2025)

Instructive Code Retriever: Learn from Large Language Model's Feedback for Code Intelligence Tasks
by: Lu, Jiawei, et al.
Published: (2024)

ContractEval: A Benchmark for Evaluating Contract-Satisfying Assertions in Code Generation
by: Lim, Soohan, et al.
Published: (2025)

SolEval: Benchmarking Large Language Models for Repository-level Solidity Code Generation
by: Peng, Zhiyuan, et al.
Published: (2025)

LLM4SZZ: Enhancing SZZ Algorithm with Context-Enhanced Assessment on Large Language Models
by: Tang, Lingxiao, et al.
Published: (2025)

CodeReasoner: Enhancing the Code Reasoning Ability with Reinforcement Learning
by: Tang, Lingxiao, et al.
Published: (2025)

Trace: Securing Smart Contract Repository Against Access Control Vulnerability
by: Chen, Chong, et al.
Published: (2025)

Automated Invariant Generation for Solidity Smart Contracts
by: Liu, Ye, et al.
Published: (2024)

An Iterative Test-and-Repair Framework for Competitive Code Generation
by: Tang, Lingxiao, et al.
Published: (2026)

Automating Comment Generation for Smart Contract from Bytecode
by: Xiang, Jianhang, et al.
Published: (2025)

CRPWarner: Warning the Risk of Contract-related Rug Pull in DeFi Smart Contracts
by: Lin, Zewei, et al.
Published: (2024)

Identifying Smart Contract Security Issues in Code Snippets from Stack Overflow
by: Chen, Jiachi, et al.
Published: (2024)

Definition and Detection of Centralization Defects in Smart Contracts
by: Lin, Zewei, et al.
Published: (2024)

FGIT: Fault-Guided Fine-Tuning for Code Generation
by: Fan, Lishui, et al.
Published: (2025)

Copy-and-Paste? Identifying EVM-Inequivalent Code Smells in Multi-chain Reuse Contracts
by: Wang, Zexu, et al.
Published: (2025)

DAppSCAN: Building Large-Scale Datasets for Smart Contract Weaknesses in DApp Projects
by: Zheng, Zibin, et al.
Published: (2023)

ExecVerify: White-Box RL with Verifiable Stepwise Rewards for Code Execution Reasoning
by: Tang, Lingxiao, et al.
Published: (2026)

Efficiently Detecting Reentrancy Vulnerabilities in Complex Smart Contracts
by: Wang, Zexu, et al.
Published: (2024)

Balancing Latency and Accuracy of Code Completion via Local-Cloud Model Cascading
by: Lu, Hanzhen, et al.
Published: (2026)

A Benchmark for Evaluating Repository-Level Code Agents with Intermediate Reasoning on Feature Addition Task
by: Liu, Shuhan, et al.
Published: (2026)

ProjectEval: A Benchmark for Programming Agents Automated Evaluation on Project-Level Code Generation
by: Liu, Kaiyuan, et al.
Published: (2025)

Uncover the Premeditated Attacks: Detecting Exploitable Reentrancy Vulnerabilities by Identifying Attacker Contracts
by: Yang, Shuo, et al.
Published: (2024)

SmartOracle: Generating Smart Contract Oracle via Fine-Grained Invariant Detection
by: Su, Jianzhong, et al.
Published: (2024)

Beyond Code Similarity: Benchmarking the Plausibility, Efficiency, and Complexity of LLM-Generated Smart Contracts
by: Salzano, Francesco, et al.
Published: (2025)

FORGE: An LLM-driven Framework for Large-Scale Smart Contract Vulnerability Dataset Construction
by: Chen, Jiachi, et al.
Published: (2025)

Improving Retrieval-Augmented Code Comment Generation by Retrieving for Generation
by: Lu, Hanzhen, et al.
Published: (2024)

Enhancing The Open Network: Definition and Automated Detection of Smart Contract Defects
by: Song, Hao, et al.
Published: (2025)

SolAgent: A Specialized Multi-Agent Framework for Solidity Code Generation
by: Chen, Wei, et al.
Published: (2026)

Why Is My Transaction Risky? Understanding Smart Contract Semantics and Interactions in the NFT Ecosystem
by: Chen, Yujing, et al.
Published: (2025)

Demystifying and Detecting Cryptographic Defects in Ethereum Smart Contracts
by: Zhang, Jiashuo, et al.
Published: (2024)

NoCode-bench: A Benchmark for Evaluating Natural Language-Driven Feature Addition
by: Deng, Le, et al.
Published: (2025)

FEA-Bench: A Benchmark for Evaluating Repository-Level Code Generation for Feature Implementation
by: Li, Wei, et al.
Published: (2025)

Automated Vulnerability Injection in Solidity Smart Contracts: A Mutation-Based Approach for Benchmark Development
by: Iuliano, Gerardo, et al.
Published: (2025)

ComplexCodeEval: A Benchmark for Evaluating Large Code Models on More Complex Code
by: Feng, Jia, et al.
Published: (2024)

SCPatcher: Automated Smart Contract Code Repair via Retrieval-Augmented Generation and Knowledge Graph
by: Li, Xiaoqi, et al.
Published: (2026)

Contract-Coding: Towards Repo-Level Generation via Structured Symbolic Paradigm
by: Lin, Yi, et al.
Published: (2026)

Demystifying the Characteristics for Smart Contract Upgrades
by: Liu, Ye, et al.
Published: (2024)

When ChatGPT Meets Smart Contract Vulnerability Detection: How Far Are We?
by: Chen, Chong, et al.
Published: (2023)

Dataset of Yul Contracts to Support Solidity Compiler Research
by: Fonal, Krzysztof
Published: (2025)

ClassEval-Pro: A Cross-Domain Benchmark for Class-Level Code Generation
by: Chen, Yeheng, et al.
Published: (2026)