Image de couverture de livre

MERA: A Comprehensive LLM Evaluation in Russian

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Fenogenova, Alena, Chervyakov, Artem, Martynov, Nikita, Kozlova, Anastasia, Tikhonova, Maria, Akhmetgareeva, Albina, Emelyanov, Anton, Shevelev, Denis, Lebedev, Pavel, Sinev, Leonid, Isaeva, Ulyana, Kolomeytseva, Katerina, Moskovskiy, Daniil, Goncharova, Elizaveta, Savushkin, Nikita, Mikhailova, Polina, Dimitrov, Denis, Panchenko, Alexander, Markov, Sergei
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Multimodal Evaluation of Russian-language Architectures
par: Chervyakov, Artem, et autres
Publié: (2025)

Long Input Benchmark for Russian Analysis
par: Churin, Igor, et autres
Publié: (2024)

SynthDetoxM: Modern LLMs are Few-Shot Parallel Detoxification Data Annotators
par: Moskovskiy, Daniil, et autres
Publié: (2025)

Eye of Judgement: Dissecting the Evaluation of Russian-speaking LLMs with POLLUX
par: Martynov, Nikita, et autres
Publié: (2025)

The Shape of Learning: Anisotropy and Intrinsic Dimensions in Transformer-Based Models
par: Razzhigaev, Anton, et autres
Publié: (2023)

Your Transformer is Secretly Linear
par: Razzhigaev, Anton, et autres
Publié: (2024)

<think> So let's replace this phrase with insult... </think> Lessons learned from generation of toxic texts with LLMs
par: Pletenev, Sergey, et autres
Publié: (2025)

Notes on Images and Communication
par: Martynov, Denis
Publié: (2026)

MERA Code: A Unified Framework for Evaluating Code Generation Across Tasks
par: Chervyakov, Artem, et autres
Publié: (2025)

SONAR-LLM: Autoregressive Transformer that Thinks in Sentence Embeddings and Speaks in Tokens
par: Dragunov, Nikita, et autres
Publié: (2025)

FiMMIA: scaling semantic perturbation-based membership inference across modalities
par: Emelyanov, Anton, et autres
Publié: (2025)

Critical behavior of isotropic systems with strong dipole-dipole interaction from the functional renormalization group
par: Kalagov, Georgii, et autres
Publié: (2026)

Topology of a uniform spanning tree on a cylinder
par: Kalinin, Nikita, et autres
Publié: (2026)

GigaEmbeddings: Efficient Russian Language Embedding Model
par: Kolodin, Egor, et autres
Publié: (2025)

OmniFusion Technical Report
par: Goncharova, Elizaveta, et autres
Publié: (2024)

The Russian-focused embedders' exploration: ruMTEB benchmark and Russian embedding model design
par: Snegirev, Artem, et autres
Publié: (2024)

Schrödinger bridge problem via empirical risk minimization
par: Belomestny, Denis, et autres
Publié: (2026)

Tight Bounds for Schrödinger Potential Estimation in Unpaired Data Translation
par: Puchkin, Nikita, et autres
Publié: (2025)

Sentence-Anchored Gist Compression for Long-Context LLMs
par: Tarasov, Dmitrii, et autres
Publié: (2025)

Simple Vision-Language Math Reasoning via Rendered Text
par: Skripkin, Matvey, et autres
Publié: (2025)

When Less is Enough: Adaptive Token Reduction for Efficient Image Representation
par: Allakhverdov, Eduard, et autres
Publié: (2025)

Adaptive Cost Model for Query Optimization
par: Vasilenko, Nikita, et autres
Publié: (2024)

Harmonic polynomials and other exactly computable characteristics for $2$-dimensional random walks in cones
par: Denisov, Denis, et autres
Publié: (2026)

SWE-MERA: A Dynamic Benchmark for Agenticly Evaluating Large Language Models on Software Engineering Tasks
par: Adamenko, Pavel, et autres
Publié: (2025)

RusCode: Russian Cultural Code Benchmark for Text-to-Image Generation
par: Vasilev, Viacheslav, et autres
Publié: (2025)

Product-Quantised Image Representation for High-Quality Image Synthesis
par: Zavadski, Denis, et autres
Publié: (2025)

The Information-Coherence Model of Reality
par: Shevelev, Dmitry
Publié: (2025)

Vision-Language Models Unlock Task-Centric Latent Actions
par: Nikulin, Alexander, et autres
Publié: (2026)

NinA: Normalizing Flows in Action. Training VLA Models with Normalizing Flows
par: Tarasov, Denis, et autres
Publié: (2025)

Back to Basics: Revisiting Exploration in Reinforcement Learning for LLM Reasoning via Generative Probabilities
par: Li, Pengyi, et autres
Publié: (2026)

Image Reconstruction as a Tool for Feature Analysis
par: Allakhverdov, Eduard, et autres
Publié: (2025)

MOVE: A Mixture-of-Vision-Encoders Approach for Domain-Focused Vision-Language Processing
par: Skripkin, Matvey, et autres
Publié: (2025)

Addressing Hallucinations in Language Models with Knowledge Graph Embeddings as an Additional Modality
par: Chekalina, Viktoriia, et autres
Publié: (2024)

DRAGOn: Designing RAG On Periodically Updated Corpus
par: Chernogorskii, Fedor, et autres
Publié: (2025)

Sample complexity of Schrödinger potential estimation
par: Puchkin, Nikita, et autres
Publié: (2025)

Beneath the Surface of Unfounded Belief Systems: An Extended Test of the Dimensionality Hypothesis
par: Albina Gallyamova, et autres
Publié: (2026)

Yes, Q-learning Helps Offline In-Context RL
par: Tarasov, Denis, et autres
Publié: (2025)

Object-Centric Latent Action Learning
par: Klepach, Albina, et autres
Publié: (2025)

Approaches of frequency-dependent squeezing for the low frequency detector of Einstein Telescope
par: Peng, Xingrui, et autres
Publié: (2024)

A High-Finesse Suspended Interferometric Sensor for Macroscopic Quantum Mechanics with Femtometre Sensitivity
par: Smetana, Jiri, et autres
Publié: (2024)