Imagen de Portada

The AI Language Proficiency Monitor -- Tracking the Progress of LLMs on Multilingual Benchmarks

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Pomerenke, David, Nothnagel, Jonas, Ostermann, Simon
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Adapting Multilingual LLMs to Low-Resource Languages with Knowledge Graphs via Adapters
por: Gurgurov, Daniil, et al.
Publicado: (2024)

On Multilingual Encoder Language Model Compression for Low-Resource Languages
por: Gurgurov, Daniil, et al.
Publicado: (2025)

GrEmLIn: A Repository of Green Baseline Embeddings for 87 Low-Resource Languages Injected with Multilingual Graph Knowledge
por: Gurgurov, Daniil, et al.
Publicado: (2024)

Small Models, Big Impact: Efficient Corpus and Graph-Based Adaptation of Small Multilingual Language Models for Low-Resource Languages
por: Gurgurov, Daniil, et al.
Publicado: (2025)

Large Language Models for Multilingual Previously Fact-Checked Claim Detection
por: Vykopal, Ivan, et al.
Publicado: (2025)

Multilingual Political Views of Large Language Models: Identification and Steering
por: Gurgurov, Daniil, et al.
Publicado: (2025)

UniversalCEFR: Enabling Open Multilingual Research on Language Proficiency Assessment
por: Imperial, Joseph Marvin, et al.
Publicado: (2025)

Soft Language Prompts for Language Transfer
por: Vykopal, Ivan, et al.
Publicado: (2024)

Multilingual Steering by Design: Multilingual Sparse Autoencoders and Principled Layer Selection
por: Ghussin, Yusser Al, et al.
Publicado: (2026)

The Lookahead Limitation: Why Multi-Operand Addition is Hard for LLMs
por: Baeumel, Tanja, et al.
Publicado: (2025)

DiscoTrack: A Multilingual LLM Benchmark for Discourse Tracking
por: Bu, Lanni, et al.
Publicado: (2025)

Disentangling Mathematical Reasoning in LLMs: A Methodological Investigation of Internal Mechanisms
por: Baeumel, Tanja, et al.
Publicado: (2026)

Disce aut Deficere: Evaluating LLMs Proficiency on the INVALSI Italian Benchmark
por: Mercorio, Fabio, et al.
Publicado: (2024)

MathBench: Evaluating the Theory and Application Proficiency of LLMs with a Hierarchical Mathematics Benchmark
por: Liu, Hongwei, et al.
Publicado: (2024)

ProLex: A Benchmark for Language Proficiency-oriented Lexical Substitution
por: Zhang, Xuanming, et al.
Publicado: (2024)

MiLiC-Eval: Benchmarking Multilingual LLMs for China's Minority Languages
por: Zhang, Chen, et al.
Publicado: (2025)

Testing Low-Resource Language Support in LLMs Using Language Proficiency Exams: the Case of Luxembourgish
por: Lothritz, Cedric, et al.
Publicado: (2025)

Probing Context Localization of Polysemous Words in Pre-trained Language Model Sub-Layers
por: Vijayakumar, Soniya, et al.
Publicado: (2024)

Enhancing Multilingual Counterfactual Generation through Alignment-as-Preference Optimization
por: Wang, Yilong, et al.
Publicado: (2026)

Cross-Prompt Encoder for Low-Performing Languages
por: Mikaberidze, Beso, et al.
Publicado: (2025)

Sparse Subnetwork Enhancement for Underrepresented Languages in Large Language Models
por: Gurgurov, Daniil, et al.
Publicado: (2025)

Controlling Language Confusion in Multilingual LLMs
por: Lee, Nahyun, et al.
Publicado: (2025)

Right at My Level: A Unified Multilingual Framework for Proficiency-Aware Text Simplification
por: Jeong, Jinhong, et al.
Publicado: (2026)

Generative Large Language Models in Automated Fact-Checking: A Survey
por: Vykopal, Ivan, et al.
Publicado: (2024)

IndicGenBench: A Multilingual Benchmark to Evaluate Generation Capabilities of LLMs on Indic Languages
por: Singh, Harman, et al.
Publicado: (2024)

A Rigorous Evaluation of LLM Data Generation Strategies for Low-Resource Languages
por: Anikina, Tatiana, et al.
Publicado: (2025)

From Tarzan to Tolkien: Controlling the Language Proficiency Level of LLMs for Content Generation
por: Malik, Ali, et al.
Publicado: (2024)

Multi-IF: Benchmarking LLMs on Multi-Turn and Multilingual Instructions Following
por: He, Yun, et al.
Publicado: (2024)

SciAssess: Benchmarking LLM Proficiency in Scientific Literature Analysis
por: Cai, Hengxing, et al.
Publicado: (2024)

PART: Progressive Alignment Representation Training for Multilingual Speech-To-Text with LLMs
por: Zhang, Pei, et al.
Publicado: (2025)

DFKI-MLT at SemEval-2026 TASK 7: Steering Multilingual Models Towards Cultural Knowledge
por: Ghussin, Yusser Al, et al.
Publicado: (2026)

"Be My Cheese?": Cultural Nuance Benchmarking for Machine Translation in Multilingual LLMs
por: Van Doren, Madison, et al.
Publicado: (2026)

Let's Simplify Step by Step: Guiding LLM Towards Multilingual Unsupervised Proficiency-Controlled Sentence Simplification
por: Zhang, Jingshen, et al.
Publicado: (2026)

Multilingual Datasets for Custom Input Extraction and Explanation Requests Parsing in Conversational XAI Systems
por: Wang, Qianli, et al.
Publicado: (2025)

Language Bias under Conflicting Information in Multilingual LLMs
por: Östling, Robert, et al.
Publicado: (2026)

Investigating the Influence of Language on Sycophantic Behavior of Multilingual LLMs
por: Aldahlawi, Bayan Abdullah, et al.
Publicado: (2026)

Information Loss in LLMs' Multilingual Translation: The Role of Training Data, Language Proximity, and Language Family
por: Lin, Yumeng, et al.
Publicado: (2025)

Fleurs-SLU: A Massively Multilingual Benchmark for Spoken Language Understanding
por: Schmidt, Fabian David, et al.
Publicado: (2025)

Multilingual European Language Models: Benchmarking Approaches and Challenges
por: Barth, Fabio, et al.
Publicado: (2025)

OpenFActScore: Open-Source Atomic Evaluation of Factuality in Text Generation
por: Lage, Lucas Fonseca, et al.
Publicado: (2025)