Imagen de Portada

Evaluation of Code LLMs on Geospatial Code Generation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Gramacki, Piotr, Martins, Bruno, Szymański, Piotr
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language Software Engineering
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

A Vision for Geo-Temporal Deep Research Systems: Towards Comprehensive, Transparent, and Reproducible Geo-Temporal Information Synthesis
por: Martins, Bruno, et al.
Publicado: (2025)

FairCoder: Evaluating Social Bias of LLMs in Code Generation
por: Du, Yongkang, et al.
Publicado: (2025)

Enhancing Code LLMs with Reinforcement Learning in Code Generation: A Survey
por: Wang, Junqiao, et al.
Publicado: (2024)

From Output to Evaluation: Does Raw Instruction-Tuned Code LLMs Output Suffice for Fill-in-the-Middle Code Generation?
por: Ahmad, Wasi Uddin, et al.
Publicado: (2025)

Code-Vision: Evaluating Multimodal LLMs Logic Understanding and Code Generation Capabilities
por: Wang, Hanbin, et al.
Publicado: (2025)

Is Your AI-Generated Code Really Safe? Evaluating Large Language Models on Secure Code Generation with CodeSecEval
por: Wang, Jiexin, et al.
Publicado: (2024)

EvoCodeBench: An Evolving Code Generation Benchmark with Domain-Specific Evaluations
por: Li, Jia, et al.
Publicado: (2024)

Showing LLM-Generated Code Selectively Based on Confidence of LLMs
por: Li, Jia, et al.
Publicado: (2024)

AetherCode: Evaluating LLMs' Ability to Win In Premier Programming Competitions
por: Wang, Zihan, et al.
Publicado: (2025)

Chain-of-Programming (CoP) : Empowering Large Language Models for Geospatial Code Generation
por: Hou, Shuyang, et al.
Publicado: (2024)

CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation
por: Yan, Weixiang, et al.
Publicado: (2023)

Evaluating and Achieving Controllable Code Completion in Code LLM
por: Zhang, Jiajun, et al.
Publicado: (2026)

CodeHalu: Investigating Code Hallucinations in LLMs via Execution-based Verification
por: Tian, Yuchen, et al.
Publicado: (2024)

CodeSpecBench: Benchmarking LLMs for Executable Behavioral Specification Generation
por: Chen, Zaoyu, et al.
Publicado: (2026)

OpenCodeInstruct: A Large-scale Instruction Tuning Dataset for Code LLMs
por: Ahmad, Wasi Uddin, et al.
Publicado: (2025)

VersiCode: Towards Version-controllable Code Generation
por: Wu, Tongtong, et al.
Publicado: (2024)

Code Fingerprints: Disentangled Attribution of LLM-Generated Code
por: Guo, Jiaxun, et al.
Publicado: (2026)

Humanity's Last Code Exam: Can Advanced LLMs Conquer Human's Hardest Code Competition?
por: Li, Xiangyang, et al.
Publicado: (2025)

CodeRAG-Bench: Can Retrieval Augment Code Generation?
por: Wang, Zora Zhiruo, et al.
Publicado: (2024)

CodeJudge: Evaluating Code Generation with Large Language Models
por: Tong, Weixi, et al.
Publicado: (2024)

CONCUR: Benchmarking LLMs for Concurrent Code Generation
por: Huang, Jue, et al.
Publicado: (2026)

PerfCodeBench: Benchmarking LLMs for System-Level High-Performance Code Optimization
por: Jing, Huihao, et al.
Publicado: (2026)

LeetCodeDataset: A Temporal Dataset for Robust Evaluation and Efficient Training of Code LLMs
por: Xia, Yunhui, et al.
Publicado: (2025)

Don't Judge Code by Its Cover: Exploring Biases in LLM Judges for Code Evaluation
por: Moon, Jiwon, et al.
Publicado: (2025)

CodeBenchGen: Creating Scalable Execution-based Code Generation Benchmarks
por: Xie, Yiqing, et al.
Publicado: (2024)

AutoCodeBench: Large Language Models are Automatic Code Benchmark Generators
por: Chou, Jason, et al.
Publicado: (2025)

ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluation
por: Zhang, Chenchen, et al.
Publicado: (2025)

NLPerturbator: Studying the Robustness of Code LLMs to Natural Language Variations
por: Chen, Junkai, et al.
Publicado: (2024)

Model Editing for LLMs4Code: How Far are We?
por: Li, Xiaopeng, et al.
Publicado: (2024)

Coffee: Boost Your Code LLMs by Fixing Bugs with Feedback
por: Moon, Seungjun, et al.
Publicado: (2023)

LLMs for Science: Usage for Code Generation and Data Analysis
por: Nejjar, Mohamed, et al.
Publicado: (2023)

Comparing Developer and LLM Biases in Code Evaluation
por: Mittal, Aditya, et al.
Publicado: (2026)

Iterative Refinement of Project-Level Code Context for Precise Code Generation with Compiler Feedback
por: Bi, Zhangqian, et al.
Publicado: (2024)

Is Vibe Coding Safe? Benchmarking Vulnerability of Agent-Generated Code in Real-World Tasks
por: Zhao, Songwen, et al.
Publicado: (2025)

CodeFlowBench: A Multi-turn, Iterative Benchmark for Complex Code Generation
por: Wang, Sizhe, et al.
Publicado: (2025)

MERA Code: A Unified Framework for Evaluating Code Generation Across Tasks
por: Chervyakov, Artem, et al.
Publicado: (2025)

FEA-Bench: A Benchmark for Evaluating Repository-Level Code Generation for Feature Implementation
por: Li, Wei, et al.
Publicado: (2025)

LLMSniffer: Detecting LLM-Generated Code via GraphCodeBERT and Supervised Contrastive Learning
por: Dihan, Mahir Labib, et al.
Publicado: (2026)

Evaluating Language Models for Efficient Code Generation
por: Liu, Jiawei, et al.
Publicado: (2024)

ProjectEval: A Benchmark for Programming Agents Automated Evaluation on Project-Level Code Generation
por: Liu, Kaiyuan, et al.
Publicado: (2025)