Cover Image

On Leakage of Code Generation Evaluation Datasets

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Matton, Alexandre, Sherborne, Tom, Aumiller, Dennis, Tommasone, Elena, Alizadeh, Milad, He, Jingyi, Ma, Raymond, Voisin, Maxime, Gilsenan-McMahon, Ellen, Gallé, Matthias
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Verification Limits Code LLM Training
by: Gureja, Srishti, et al.
Published: (2025)

Beyond the Baseband: Adaptive Multi-Band Encoding for Full-Spectrum Bioacoustics Classification
by: Sarkar, Eklavya, et al.
Published: (2026)

Agents Explore but Agents Ignore: LLMs Lack Environmental Curiosity
by: Engländer, Leon, et al.
Published: (2026)

BAGEL: Benchmarking Animal Knowledge Expertise in Language Models
by: Shen, Jiacheng, et al.
Published: (2026)

The Violence of the Letter
by: McMahon, Melanie
Published: (2023)

Applying economic analysis to technical asistance projects / Gary McMahon
by: McMahon, Gary
Published: (1997)

Post-Oslo Peace Initiatives and the Discourse of Palestinian-Israeli Relations
by: Sean McMahon
Published: (2011)

Terapêutica clínica - Insulina inalada para a diabetes mellitus
by: Graham T McMahon
Published: (2007)

Altered States: Books into Video.
by: McMahon, Judith
Published: (1990)

Computerizing the Chinese International School Libraries.
by: McMahon, Marilyn
Published: (1993)

Feeding the Byzantine City: The Archaeology of Consumption in the Eastern Mediterranean (ca. 500–1500). Edited by JoanitaVroom. Medieval and Post‐Medieval Mediterranean Archaeology5. Turnhout: Brepols. 2023. 350 pp. + 157 figures, chiefly colour. €75. ISBN 978 2 503 60566 1. ISSN 2565 8719.
by: Lucas McMahon
Published: (2024)

Byzantine Attica: An Archaeology of Settlement and Landscape, 4th to 12th Centuries. By ElliTzavella. Turnhout: Brepols. 2024. 664 pp. €180. ISBN 978 2 503 61120 4.
by: Lucas McMahon
Published: (2025)

Epigenetic Responsibility and Foreseeable Risk
by: Courtney McMahon
Published: (2026)

If You Can't Use Them, Recycle Them: Optimizing Merging at Scale Mitigates Performance Tradeoffs
by: Khalifa, Muhammad, et al.
Published: (2024)

Evolutionary and physiological adaptations of aquatic invasive animals : r selection versus resistance
by: McMahon, R. F
Published: (2002)

Relations Between Accountability and School Improvement Strategies in New York City’s Children First Networks
by: Kelly A. McMahon
Published: (2017)

Analysing written production competence descriptors for academic and professional purposes and their calibration to the CEFR
by: Joana Pierce McMahon
Published: (2012)

Batch Estimation of a Steady, Uniform, Flow-Field from Ground Velocity and Heading Measurements
by: Wolek, Artur, et al.
Published: (2024)

Collaboration to support veterans: An ongoing project in the Pikes Peak region
by: Dana Zimbleman, et al.
Published: (2024)

Don't Count on Clairvoyance: A Librarian and an Independent Consultant Plan a Staff Training Workshop.
by: Ezell, Charlaine, et al.
Published: (1991)

Against epigenetic responsibility: The problem of causality in ‘foetal programming’ science
by: Courtney McMahon, et al.
Published: (2024)

ACTIONS OF PUTATIVE CARDIOINHIBITORY SUBSTANCES ON THE IN VIVO DECAPOD CARDIOVASCULAR SYSTEM
by: McGaw, L., McMahon, B
Published: (1999)

AVEX: What Matters for Animal Vocalization Encoding
by: Miron, Marius, et al.
Published: (2025)

Evaluation of a practical approach for field scale moisture flow modeling in heterogeneous media at a semiarid site
by: Raziuddin Khaleel, et al.
Published: (2024)

Mitigation of Artifacts in Multistatic & Passive Radar Imaging Using Microlocal Analysis
by: McMahon, David, et al.
Published: (2025)

Chronic Kidney Disease and Unmet Needs for Comprehensive Rehabilitation in Australia
by: Limy Wong, et al.
Published: (2026)

Multi-layer attentive probing improves transfer of audio representations for bioacoustics
by: Miron, Marius, et al.
Published: (2026)

Redefining sustainable urban development: A critical analysis in the wake of COVID ‐19
by: Hooshmand Alizadeh, et al.
Published: (2024)

Compositional Generalisation for Explainable Hate Speech Detection
by: Calabrese, Agostina, et al.
Published: (2025)

TRAM: Bridging Trust Regions and Sharpness Aware Minimization
by: Sherborne, Tom, et al.
Published: (2023)

TICKing All the Boxes: Generated Checklists Improve LLM Evaluation and Generation
by: Cook, Jonathan, et al.
Published: (2024)

Efficient Three-Dimensional Sub-Doppler Cooling of $^{40}$Ca$^+$ in a Penning Trap
by: McMahon, Brian J., et al.
Published: (2026)

Efficient Longitudinal Function-on-Function Regression
by: Verace, Leif, et al.
Published: (2026)

Development of Program Guidelines for Community and Institutional Externships.
by: Lipman, Arthur G., et al.
Published: (1979)

School Librarian Staffing Levels and Student Achievement as Represented in 2006-2009 Kansas Annual Yearly Progress Data
by: Dow, Mirah J., et al.
Published: (2012)

Running women or women runners: Does identity salience affect intention to exercise outside and feelings of safety?
by: Lisa Skilton, et al.
Published: (2024)

How People With an Intellectual Disability Experience Inclusive Third‐Level Education: A Scoping Review
by: Therese Hennessy, et al.
Published: (2024)

Sex differences in locus coeruleus physiology
by: Rosaria Josephine Rae, et al.
Published: (2024)

Informing the Design of Inclusive Post‐Secondary Education: A Qualitative Exploration of the Perspectives of Individuals With Intellectual Disabilities
by: Thérèse Hennessy, et al.
Published: (2026)

Separately measuring home‐field advantage for offenses and defenses: A panel‐data study of constituent channels within collegiate American football
by: Matthew J. McMahon, et al.
Published: (2024)