Copertina

AICoderEval: Improving AI Domain Code Generation of Large Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Xia, Yinghui, Chen, Yuyan, Shi, Tianyu, Wang, Jun, Yang, Jinsong
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Is Your AI-Generated Code Really Safe? Evaluating Large Language Models on Secure Code Generation with CodeSecEval
di: Wang, Jiexin, et al.
Pubblicazione: (2024)

ConCodeEval: Evaluating Large Language Models for Code Constraints in Domain-Specific Languages
di: Kammakomati, Mehant, et al.
Pubblicazione: (2024)

FinEval: A Chinese Financial Domain Knowledge Evaluation Benchmark for Large Language Models
di: Guo, Xin, et al.
Pubblicazione: (2023)

ClassEval-Pro: A Cross-Domain Benchmark for Class-Level Code Generation
di: Chen, Yeheng, et al.
Pubblicazione: (2026)

FinEval-KR: A Financial Domain Evaluation Framework for Large Language Models' Knowledge and Reasoning
di: Dou, Shaoyu, et al.
Pubblicazione: (2025)

CMAT: A Multi-Agent Collaboration Tuning Framework for Enhancing Small Language Models
di: Liang, Xuechen, et al.
Pubblicazione: (2024)

VHDL-Eval: A Framework for Evaluating Large Language Models in VHDL Code Generation
di: Vijayaraghavan, Prashanth, et al.
Pubblicazione: (2024)

mHumanEval -- A Multilingual Benchmark to Evaluate Large Language Models for Code Generation
di: Raihan, Nishat, et al.
Pubblicazione: (2024)

Recent Advancement of Emotion Cognition in Large Language Models
di: Chen, Yuyan, et al.
Pubblicazione: (2024)

AdaptEval: Evaluating Large Language Models on Domain Adaptation for Text Summarization
di: Afzal, Anum, et al.
Pubblicazione: (2024)

SocialEval: Evaluating Social Intelligence of Large Language Models
di: Zhou, Jinfeng, et al.
Pubblicazione: (2025)

Improving Natural Language Capability of Code Large Language Model
di: Li, Wei, et al.
Pubblicazione: (2024)

R-Eval: A Unified Toolkit for Evaluating Domain Knowledge of Retrieval Augmented Large Language Models
di: Tu, Shangqing, et al.
Pubblicazione: (2024)

CT-Eval: Benchmarking Chinese Text-to-Table Performance in Large Language Models
di: Shi, Haoxiang, et al.
Pubblicazione: (2024)

LanguaShrink: Reducing Token Overhead with Psycholinguistics
di: Liang, Xuechen, et al.
Pubblicazione: (2024)

MetaGPT: Merging Large Language Models Using Model Exclusive Task Arithmetic
di: Zhou, Yuyan, et al.
Pubblicazione: (2024)

CodeJudge-Eval: Can Large Language Models be Good Judges in Code Understanding?
di: Zhao, Yuwei, et al.
Pubblicazione: (2024)

SparseEval: Efficient Evaluation of Large Language Models by Sparse Optimization
di: Zhang, Taolin, et al.
Pubblicazione: (2026)

Leveraging Print Debugging to Improve Code Generation in Large Language Models
di: Hu, Xueyu, et al.
Pubblicazione: (2024)

HumanEval Pro and MBPP Pro: Evaluating Large Language Models on Self-invoking Code Generation
di: Yu, Zhaojian, et al.
Pubblicazione: (2024)

AI Safety in Generative AI Large Language Models: A Survey
di: Chua, Jaymari, et al.
Pubblicazione: (2024)

EVM-QuestBench: An Execution-Grounded Benchmark for Natural-Language Transaction Code Generation
di: Yang, Pei, et al.
Pubblicazione: (2026)

LalaEval: A Holistic Human Evaluation Framework for Domain-Specific Large Language Models
di: Sun, Chongyan, et al.
Pubblicazione: (2024)

Reflective Human-Machine Co-adaptation for Enhanced Text-to-Image Generation Dialogue System
di: Feng, Yuheng, et al.
Pubblicazione: (2024)

ESC-Eval: Evaluating Emotion Support Conversations in Large Language Models
di: Zhao, Haiquan, et al.
Pubblicazione: (2024)

OpenHuEval: Evaluating Large Language Model on Hungarian Specifics
di: Yang, Haote, et al.
Pubblicazione: (2025)

OJBench: A Competition Level Code Benchmark For Large Language Models
di: Wang, Zhexu, et al.
Pubblicazione: (2025)

CriticEval: Evaluating Large Language Model as Critic
di: Lan, Tian, et al.
Pubblicazione: (2024)

VisEval: A Benchmark for Data Visualization in the Era of Large Language Models
di: Chen, Nan, et al.
Pubblicazione: (2024)

LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation
di: Ye, Xi, et al.
Pubblicazione: (2025)

Improving Retrieval Augmented Language Model with Self-Reasoning
di: Xia, Yuan, et al.
Pubblicazione: (2024)

Large Language Model for Multi-Domain Translation: Benchmarking and Domain CoT Fine-tuning
di: Hu, Tianxiang, et al.
Pubblicazione: (2024)

CRiskEval: A Chinese Multi-Level Risk Evaluation Benchmark Dataset for Large Language Models
di: Shi, Ling, et al.
Pubblicazione: (2024)

MdEval: Massively Multilingual Code Debugging
di: Liu, Shukai, et al.
Pubblicazione: (2024)

UCoder: Unsupervised Code Generation by Internal Probing of Large Language Models
di: Wu, Jiajun, et al.
Pubblicazione: (2025)

S-Eval: Towards Automated and Comprehensive Safety Evaluation for Large Language Models
di: Yuan, Xiaohan, et al.
Pubblicazione: (2024)

AgriEval: A Comprehensive Chinese Agricultural Benchmark for Large Language Models
di: Yan, Lian, et al.
Pubblicazione: (2025)

MedEthicEval: Evaluating Large Language Models Based on Chinese Medical Ethics
di: Jin, Haoan, et al.
Pubblicazione: (2025)

LogEval: A Comprehensive Benchmark Suite for Large Language Models In Log Analysis
di: Cui, Tianyu, et al.
Pubblicazione: (2024)

S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Models
di: Lei, Fangyu, et al.
Pubblicazione: (2023)