SciCode: A Research Coding Benchmark Curated by Scientists
Fuente:
arXiv
Saved in:
| Main Authors: | Tian, Minyang, Gao, Luyu, Zhang, Shizhuo Dylan, Chen, Xinan, Fan, Cunwei, Guo, Xuefei, Haas, Roland, Ji, Pan, Krongchon, Kittithat, Li, Yao, Liu, Shengyan, Luo, Di, Ma, Yutao, Tong, Hao, Trinh, Kha, Tian, Chenyu, Wang, Zihan, Wu, Bohao, Xiong, Yanyu, Yin, Shengzhu, Zhu, Minhui, Lieret, Kilian, Lu, Yanxin, Liu, Genglin, Du, Yufeng, Tao, Tianhua, Press, Ofir, Callan, Jamie, Huerta, Eliu, Peng, Hao |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Repository-level Code Search with Neural Retrieval Methods
by: Gandhi, Siddharth, et al.
Published: (2025)
by: Gandhi, Siddharth, et al.
Published: (2025)
CodeClash: Benchmarking Goal-Oriented Software Engineering
by: Yang, John, et al.
Published: (2025)
by: Yang, John, et al.
Published: (2025)
Graphene-hBN interlayer interactions from quantum Monte Carlo
by: Krongchon, Kittithat, et al.
Published: (2025)
by: Krongchon, Kittithat, et al.
Published: (2025)
RoPE Distinguishes Neither Positions Nor Tokens in Long Contexts, Provably
by: Du, Yufeng, et al.
Published: (2026)
by: Du, Yufeng, et al.
Published: (2026)
ACER: Automatic Language Model Context Extension via Retrieval
by: Gao, Luyu, et al.
Published: (2024)
by: Gao, Luyu, et al.
Published: (2024)
SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering
by: Yang, John, et al.
Published: (2024)
by: Yang, John, et al.
Published: (2024)
Context Length Alone Hurts LLM Performance Despite Perfect Retrieval
by: Du, Yufeng, et al.
Published: (2025)
by: Du, Yufeng, et al.
Published: (2025)
MDS and NMDS Codes from the Extended Twisted Generalized Reed-Solomon Codes
by: Wang, Yanli, et al.
Published: (2026)
by: Wang, Yanli, et al.
Published: (2026)
Sicheres autonomes Flugrobotersystem für den Einsatz im Produktions- und Logistikumfeld
by: Lieret, Markus
Published: (2025)
by: Lieret, Markus
Published: (2025)
Estudio y análisis socio-histórico del Control Social
by: Eliú Cardozo Sáez
Published: (2013)
by: Eliú Cardozo Sáez
Published: (2013)
Merging mechanical bound states in the continuum in high-aspect-ratio phononic crystal gratings
by: Tong, Hao, et al.
Published: (2023)
by: Tong, Hao, et al.
Published: (2023)
SWE-smith: Scaling Data for Software Engineering Agents
by: Yang, John, et al.
Published: (2025)
by: Yang, John, et al.
Published: (2025)
CiteME: Can Language Models Accurately Cite Scientific Claims?
by: Press, Ori, et al.
Published: (2024)
by: Press, Ori, et al.
Published: (2024)
Quasi-Perfect and Distance-Optimal Codes Sum-Rank Codes
by: Chen, Hao
Published: (2024)
by: Chen, Hao
Published: (2024)
Coding with the transverse intersection algebra
by: Aharoni, Ofir, et al.
Published: (2025)
by: Aharoni, Ofir, et al.
Published: (2025)
Advancing Language Models for Code-related Tasks
by: Tian, Zhao
Published: (2026)
by: Tian, Zhao
Published: (2026)
Real‐Time Decoding For Surface Code
by: Jia‐Ning Li, et al.
Published: (2026)
by: Jia‐Ning Li, et al.
Published: (2026)
Examining LLMs' Uncertainty Expression Towards Questions Outside Parametric Knowledge
by: Liu, Genglin, et al.
Published: (2023)
by: Liu, Genglin, et al.
Published: (2023)
AttenGW: A Lightweight Attention-Based Multi-Detector Gravitational-Wave Detection Pipeline
by: Tiki, Victoria, et al.
Published: (2025)
by: Tiki, Victoria, et al.
Published: (2025)
Hijo de tigre... ¿pintito? Perspectivas del tiempo y espacio. Cambios generacionales entre la comunidad cristiana evangélica
by: Angélica Eliú Patiño Reséndiz
Published: (2014)
by: Angélica Eliú Patiño Reséndiz
Published: (2014)
SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?
by: Yang, John, et al.
Published: (2024)
by: Yang, John, et al.
Published: (2024)
Selective Prompt Anchoring for Code Generation
by: Tian, Yuan, et al.
Published: (2024)
by: Tian, Yuan, et al.
Published: (2024)
Use of virtual reality in patient education program to reduce anxiety in upper gastrointestinal endoscopy: A randomized controlled trial
by: Surachet Siripongsaporn, et al.
Published: (2024)
by: Surachet Siripongsaporn, et al.
Published: (2024)
Physics-inspired spatiotemporal-graph AI ensemble for the detection of higher order wave mode signals of spinning binary black hole mergers
by: Tian, Minyang, et al.
Published: (2023)
by: Tian, Minyang, et al.
Published: (2023)
Short Wins Long: Short Codes with Language Model Semantic Correction Outperform Long Codes
by: Hao, Jiafu, et al.
Published: (2025)
by: Hao, Jiafu, et al.
Published: (2025)
ProgramBench: Can Language Models Rebuild Programs From Scratch?
by: Yang, John, et al.
Published: (2026)
by: Yang, John, et al.
Published: (2026)
Aligning Requirement for Large Language Model's Code Generation
by: Tian, Zhao, et al.
Published: (2025)
by: Tian, Zhao, et al.
Published: (2025)
Do Comments and Expertise Still Matter? An Experiment on Programmers' Adoption of AI-Generated JavaScript Code
by: Li, Changwen, et al.
Published: (2025)
by: Li, Changwen, et al.
Published: (2025)
Tevatron 2.0: Unified Document Retrieval Toolkit across Scale, Language, and Modality
by: Ma, Xueguang, et al.
Published: (2025)
by: Ma, Xueguang, et al.
Published: (2025)
DALC: Distributed Arithmetic Coding Aided by Linear Codes
by: Zhou, Junwei, et al.
Published: (2025)
by: Zhou, Junwei, et al.
Published: (2025)
On the Minimum Distances of Some Families of Goppa Codes and BCH Codes
by: Chen, Yaqi, et al.
Published: (2026)
by: Chen, Yaqi, et al.
Published: (2026)
Adaptive Deformation of Color Code in Square Lattices with Defects
by: Wei, Tian-Hao, et al.
Published: (2026)
by: Wei, Tian-Hao, et al.
Published: (2026)
Formation of Rotating Structures from Vacuum Pressure Gradients: A Pressure-Driven Gravity Model
by: Callan, Ylia
Published: (2025)
by: Callan, Ylia
Published: (2025)
High Redshift Galaxy Formation: A Pressure Driven Gravity Approach
by: Callan, Ylia
Published: (2025)
by: Callan, Ylia
Published: (2025)
Optimal Codes with Positive Griesmer Defects, Related Optimal and Almost Optimal LRC Codes
by: Wang, Yurui, et al.
Published: (2026)
by: Wang, Yurui, et al.
Published: (2026)
daleihao/RDycore_ROS: Codes and data for the RDycore-ROS study
by: Dalei Hao
Published: (2025)
by: Dalei Hao
Published: (2025)
On the MacWilliams Theorem over Codes and Lattices
by: Zheng, Zhiyong, et al.
Published: (2024)
by: Zheng, Zhiyong, et al.
Published: (2024)
Zero-Shot Detection of LLM-Generated Code via Approximated Task Conditioning
by: Ashkenazi, Maor, et al.
Published: (2025)
by: Ashkenazi, Maor, et al.
Published: (2025)
Code2Worlds: Empowering Coding LLMs for 4D World Generation
by: Zhang, Yi, et al.
Published: (2026)
by: Zhang, Yi, et al.
Published: (2026)
Griesmer and Optimal Linear Codes from the Affine Solomon-Stiffler Construction
by: Chen, Hao
Published: (2024)
by: Chen, Hao
Published: (2024)
Similar Items
-
Repository-level Code Search with Neural Retrieval Methods
by: Gandhi, Siddharth, et al.
Published: (2025) -
CodeClash: Benchmarking Goal-Oriented Software Engineering
by: Yang, John, et al.
Published: (2025) -
Graphene-hBN interlayer interactions from quantum Monte Carlo
by: Krongchon, Kittithat, et al.
Published: (2025) -
RoPE Distinguishes Neither Positions Nor Tokens in Long Contexts, Provably
by: Du, Yufeng, et al.
Published: (2026) -
ACER: Automatic Language Model Context Extension via Retrieval
by: Gao, Luyu, et al.
Published: (2024)