Buchumschlag

ZNO-Eval: Benchmarking reasoning capabilities of large language models in Ukrainian

Fuente: arXiv

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Syromiatnikov, Mykyta, Ruvinskaya, Victoria, Troynina, Anastasiya
Format:	Preprint
Veröffentlicht:	2025
Schlagworte:	Computation and Language Artificial Intelligence
Online-Zugang:	Acceder al recurso
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Ähnliche Einträge

UA-Code-Bench: A Competitive Programming Benchmark for Evaluating LLM Code Generation in Ukrainian
von: Syromiatnikov, Mykyta, et al.
Veröffentlicht: (2025)

Empowering Smaller Models: Tuning LLaMA and Gemma with Chain-of-Thought for Ukrainian Exam Tasks
von: Syromiatnikov, Mykyta, et al.
Veröffentlicht: (2025)

ClinicalGPT-R1: Pushing reasoning capability of generalist disease diagnosis with large language model
von: Lan, Wuyang, et al.
Veröffentlicht: (2025)

Response: Emergent analogical reasoning in large language models
von: Hodel, Damian, et al.
Veröffentlicht: (2023)

MathDivide: Improved mathematical reasoning by large language models
von: Srivastava, Saksham Sahai, et al.
Veröffentlicht: (2024)

Enhancing reasoning accuracy in large language models during inference time
von: Sharma, Vinay, et al.
Veröffentlicht: (2026)

ChildEval: When large language models meet children's personalities
von: Luo, Yanyan, et al.
Veröffentlicht: (2026)

ThoughtSource: A central hub for large language model reasoning data
von: Ott, Simon, et al.
Veröffentlicht: (2023)

Superhuman performance of a large language model on the reasoning tasks of a physician
von: Brodeur, Peter G., et al.
Veröffentlicht: (2024)

Evidence from counterfactual tasks supports emergent analogical reasoning in large language models
von: Webb, Taylor, et al.
Veröffentlicht: (2024)

TeleEval-OS: Performance evaluations of large language models for operations scheduling
von: Wang, Yanyan, et al.
Veröffentlicht: (2025)

Evidence of interrelated cognitive-like capabilities in large language models: Indications of artificial general intelligence or achievement?
von: Ilić, David, et al.
Veröffentlicht: (2023)

Slm-mux: Orchestrating small language models for reasoning
von: Wang, Chenyu, et al.
Veröffentlicht: (2025)

Retrieval-augmented reasoning with lean language models
von: Chan, Ryan Sze-Yin, et al.
Veröffentlicht: (2025)

Multi-step retrieval and reasoning improves radiology question answering with large language models
von: Wind, Sebastian, et al.
Veröffentlicht: (2025)

Auxiliary task demands mask the capabilities of smaller language models
von: Hu, Jennifer, et al.
Veröffentlicht: (2024)

Do explanations generalize across large reasoning models?
von: Pal, Koyena, et al.
Veröffentlicht: (2026)

Code-enabled language models can outperform reasoning models on diverse tasks
von: Zhang, Cedegao E., et al.
Veröffentlicht: (2025)

Automated stereotactic radiosurgery planning using a human-in-the-loop reasoning large language model agent
von: Nusrat, Humza, et al.
Veröffentlicht: (2025)

Dissociating language and thought in large language models
von: Mahowald, Kyle, et al.
Veröffentlicht: (2023)

HIVMedQA: Benchmarking large language models for HIV medical decision support
von: Cardenal-Antolin, Gonzalo, et al.
Veröffentlicht: (2025)

Fine-tuning large language models for domain adaptation: Exploration of training strategies, scaling, model merging and synergistic capabilities
von: Lu, Wei, et al.
Veröffentlicht: (2024)

Reinforcement learning fine-tuning of language model for instruction following and math reasoning
von: Han, Yifu, et al.
Veröffentlicht: (2025)

Large language models show fragile cognitive reasoning about human emotions
von: Bhattacharyya, Sree, et al.
Veröffentlicht: (2025)

GAOKAO-Eval: Does high scores truly reflect strong capabilities in LLMs?
von: Lei, Zhikai, et al.
Veröffentlicht: (2024)

On the attribution of confidence to large language models
von: Keeling, Geoff, et al.
Veröffentlicht: (2024)

Investigating the interaction of linguistic and mathematical reasoning in language models using multilingual number puzzles
von: Bhattacharya, Antara Raaghavi, et al.
Veröffentlicht: (2025)

Social preferences with unstable interactive reasoning: Large language models in economic trust games
von: Jiamin, Ou, et al.
Veröffentlicht: (2025)

Creativity Benchmark: A benchmark for marketing creativity for large language models
von: Bhat, Ninad, et al.
Veröffentlicht: (2025)

Benchmarking large language models for biomedical natural language processing applications and recommendations
von: Chen, Qingyu, et al.
Veröffentlicht: (2023)

Quantifying non deterministic drift in large language models
von: Nicholson, Claire
Veröffentlicht: (2026)

Can large language models build causal graphs?
von: Long, Stephanie, et al.
Veröffentlicht: (2023)

Multi-round jailbreak attack on large language models
von: Zhou, Yihua, et al.
Veröffentlicht: (2024)

The 20 questions game to distinguish large language models
von: Richardeau, Gurvan, et al.
Veröffentlicht: (2024)

Representation in large language models
von: Yetman, Cameron
Veröffentlicht: (2025)

Failure of contextual invariance in large language models
von: Kumar, Sagar, et al.
Veröffentlicht: (2026)

A survey of textual cyber abuse detection using cutting-edge language models and large language models
von: Diaz-Garcia, Jose A., et al.
Veröffentlicht: (2025)

Is your LLM trapped in a Mental Set? Investigative study on how mental sets affect the reasoning capabilities of LLMs
von: Haq, Saiful, et al.
Veröffentlicht: (2025)

Ukrainian-to-English folktale corpus: Parallel corpus creation and augmentation for machine translation in low-resource languages
von: Burda-Lassen, Olena
Veröffentlicht: (2024)

Streamlining evidence based clinical recommendations with large language models
von: Li, Dubai, et al.
Veröffentlicht: (2025)