Cover Image

MERA Code: A Unified Framework for Evaluating Code Generation Across Tasks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chervyakov, Artem, Kharitonov, Alexander, Zadorozhny, Pavel, Pavel, Adamenko, Levichev, Rodion, Vorobev, Dmitrii, Salikhov, Dmitrii, Valeev, Aidar, Pestova, Alena, Dziuba, Maria, Alimova, Ilseyar, Zavgorodnev, Artem, Medvedev, Aleksandr, Moiseev, Stanislav, Bruches, Elena, Grebenkin, Daniil, Derunets, Roman, Vladimir, Vikulov, Emelyanov, Anton, Babaev, Dmitrii, Ivanov, Vladimir V., Malykh, Valentin, Fenogenova, Alena
Format:	Preprint
Published:	2025
Subjects:	Software Engineering Artificial Intelligence Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SWE-MERA: A Dynamic Benchmark for Agenticly Evaluating Large Language Models on Software Engineering Tasks
by: Adamenko, Pavel, et al.
Published: (2025)

Real-time Localization of a Soccer Ball from a Single Camera
by: Vorobev, Dmitrii, et al.
Published: (2025)

d-Wave Hall effect and linear magnetoconductivity in metallic collinear antiferromagnets
by: Vorobev, Dmitrii L., et al.
Published: (2023)

Evaluating AI cyber capabilities with crowdsourced elicitation
by: Petrov, Artem, et al.
Published: (2025)

Multimodal Evaluation of Russian-language Architectures
by: Chervyakov, Artem, et al.
Published: (2025)

MERA: A Comprehensive LLM Evaluation in Russian
by: Fenogenova, Alena, et al.
Published: (2024)

StRuCom: A Novel Dataset of Structured Code Comments in Russian
by: Dziuba, Maria, et al.
Published: (2025)

CIDRe: A Reference-Free Multi-Aspect Criterion for Code Comment Quality Measurement
by: Dziuba, Maria, et al.
Published: (2025)

GPT-5 at CTFs: Case Studies From Top-Tier Cybersecurity Events
by: Reworr, et al.
Published: (2025)

Топология Вселенной. Физические и методологические основания
by: Grebenkin, Artem Vladimirovich
Published: (2025)

Russian-Language Multimodal Dataset for Automatic Summarization of Scientific Papers
by: Tsanda, Alena, et al.
Published: (2024)

The Russian-focused embedders' exploration: ruMTEB benchmark and Russian embedding model design
by: Snegirev, Artem, et al.
Published: (2024)

Amplitude maximization in stable systems, Schur positivity, and some conjectures on polynomial interpolation
by: Ostrovskii, Dmitrii M., et al.
Published: (2025)

On the Entire Structure of the Energy Bands of 1D Moiré Superchain
by: Vorobev, Dmitrii, et al.
Published: (2025)

Towards Robust Speech Deepfake Detection via Human-Inspired Reasoning
by: Dvirniak, Artem, et al.
Published: (2026)

One-Way Communication Complexity of Partial XOR Functions
by: Podolskii, Vladimir V., et al.
Published: (2023)

Hacking CTFs with Plain Agents
by: Turtayev, Rustem, et al.
Published: (2024)

Benchmarking Optimizers for MLPs in Tabular Deep Learning
by: Gorishniy, Yury, et al.
Published: (2026)

SyMuPe: Affective and Controllable Symbolic Music Performance
by: Borovik, Ilya, et al.
Published: (2025)

Densemarks: Learning Canonical Embeddings for Human Heads Images via Point Tracks
by: Pozdeev, Dmitrii, et al.
Published: (2025)

FiMMIA: scaling semantic perturbation-based membership inference across modalities
by: Emelyanov, Anton, et al.
Published: (2025)

Exploring the Potential of Conversational Test Suite Based Program Repair on SWE-bench
by: Cheshkov, Anton, et al.
Published: (2024)

[SUPERSEDED — see 10.5281/zenodo.19227867] Trinity B002: Zero-DSP FPGA Architecture for Ternary Inference v4.0
by: Vasilev, Dmitrii
Published: (2026)

Generators vs. classical generators in derived categories of curves
by: Pirozhkov, Dmitrii
Published: (2025)

Published Orthogonal Replication, Strong-Core Switch Decomposition, and Arm-Polarized Fracture Geometry of a Native Fracture-State Family in a Computational Longevity Discovery Pipeline (Trinity Claims #87-#98, 2026-03-23)
by: Dmitrii, Fedorov
Published: (2026)

A Sociocultural Approach to the Development of Professional Education in the Field of Traditional Jewelry Art: Monograph
by: Dronov, Dmitrii
Published: (2025)

[SUPERSEDED — see 10.5281/zenodo.19227873] Trinity B005: Tri Language — Linear Types, Effects, Dual-Target Compilation v4.0
by: Vasilev, Dmitrii
Published: (2026)

SIRT6/Kaluski_et_al_2024: v1.0.0
by: Dmitrii Smirnov
Published: (2025)

The Gamma-Theta Conjecture holds for planar graphs
by: Taletskii, Dmitrii
Published: (2024)

On the support of admissible subcategories
by: Pirozhkov, Dmitrii
Published: (2026)

Is the Euclidean path integral always equal to the thermal partition function?
by: Diakonov, Dmitrii
Published: (2023)

Polynomial contractions of $\mathbb C^d$ and degree growth
by: Korshunov, Dmitrii
Published: (2026)

On perturbations of the DN map of a disk causing changes of surface topology
by: Korikov, Dmitrii
Published: (2025)

Levy-stable scaling of risk and performance functionals
by: Vlasiuk, Dmitrii
Published: (2025)

Stably semiorthogonally indecomposable varieties
by: Pirozhkov, Dmitrii
Published: (2020)

On sets of orthogonal exponentials on the disk
by: Zakharov, Dmitrii
Published: (2024)

Upper bounds for Heilbronn's triangle problem in higher dimensions
by: Zakharov, Dmitrii
Published: (2022)

On the minimum number of maximal distance-$k$ independent sets in trees
by: Taletskii, Dmitrii
Published: (2026)

Most integers are not a sum of two palindromes
by: Zakharov, Dmitrii
Published: (2024)

Sub-twistor metrics
by: Korshunov, Dmitrii
Published: (2024)