Cover Image

Benchmarking Procedural Language Understanding for Low-Resource Languages: A Case Study on Turkish

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Uzunoglu, Arda, Şahin, Gözde Gül
Format:	Preprint
Published:	2023
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

PARADISE: Evaluating Implicit Planning Skills of Language Models with Procedural Warnings and Tips Dataset
by: Uzunoglu, Arda, et al.
Published: (2024)

Instructional Text Across Disciplines: A Survey of Representations, Downstream Tasks, and Open Challenges Toward Capable AI Agents
by: Safa, Abdulfattah, et al.
Published: (2024)

Cetvel: A Unified Benchmark for Evaluating Language Understanding, Generation and Cultural Capacity of LLMs for Turkish
by: Er, Yakup Abrek, et al.
Published: (2025)

GECTurk WEB: An Explainable Online Platform for Turkish Grammatical Error Detection and Correction
by: Gebeşçe, Ali, et al.
Published: (2024)

A Zero-Shot Open-Vocabulary Pipeline for Dialogue Understanding
by: Safa, Abdulfattah, et al.
Published: (2024)

Linguistically-Informed Multilingual Instruction Tuning: Is There an Optimal Set of Languages to Tune?
by: Soykan, Gürkan, et al.
Published: (2024)

TurkishMMLU: Measuring Massive Multitask Language Understanding in Turkish
by: Yüksel, Arda, et al.
Published: (2024)

The Flaw of Averages: Quantifying Uniformity of Performance on Benchmarks
by: Uzunoglu, Arda, et al.
Published: (2025)

Evaluating the Quality of Benchmark Datasets for Low-Resource Languages: A Case Study on Turkish
by: Cengiz, Ayşe Aysu, et al.
Published: (2025)

Trust Functions: Near-Lossless Weak-to-Strong Generalization by Learning When to Trust the Weak Teacher
by: Uzunoglu, Arda, et al.
Published: (2026)

Tokenization Strategies for Low-Resource Agglutinative Languages in Word2Vec: Case Study on Turkish and Finnish
by: Hu, Jinfan Frank
Published: (2025)

WorldAPIs: The World Is Worth How Many APIs? A Thought Experiment
by: Ou, Jiefu, et al.
Published: (2024)

Are Non-English Papers Reviewed Fairly? Language-of-Study Bias in NLP Peer Reviews
by: Barkhordar, Ehsan, et al.
Published: (2026)

Understanding In-Context Machine Translation for Low-Resource Languages: A Case Study on Manchu
by: Pei, Renhao, et al.
Published: (2025)

Bridging the Bosphorus: Advancing Turkish Large Language Models through Strategies for Low-Resource Language Adaptation and Benchmarking
by: Acikgoz, Emre Can, et al.
Published: (2024)

Evaluating Modern Large Language Models on Low-Resource and Morphologically Rich Languages:A Cross-Lingual Benchmark Across Cantonese, Japanese, and Turkish
by: Xia, Chengxuan, et al.
Published: (2025)

Turkronicles: Diachronic Resources for the Fast Evolving Turkish Language
by: Yazar, Togay, et al.
Published: (2024)

Cross-Lingual Learning vs. Low-Resource Fine-Tuning: A Case Study with Fact-Checking in Turkish
by: Cekinel, Recep Firat, et al.
Published: (2024)

TurkBench: A Benchmark for Evaluating Turkish Large Language Models
by: Toraman, Çağrı, et al.
Published: (2026)

VLURes: Benchmarking VLM Visual and Linguistic Understanding in Low-Resource Languages
by: Atuhurra, Jesse, et al.
Published: (2025)

Multimodal Large Language Models for Low-Resource Languages: A Case Study for Basque
by: Arana, Lukas, et al.
Published: (2025)

A Comprehensive Analysis of Static Word Embeddings for Turkish
by: Sarıtaş, Karahan, et al.
Published: (2024)

Low-Resource NMT: A Case Study on the Written and Spoken Languages in Hong Kong
by: Mak, Hei Yi, et al.
Published: (2025)

Building Foundations for Natural Language Processing of Historical Turkish: Resources and Models
by: Özateş, Şaziye Betül, et al.
Published: (2025)

Dense Retrieval for Low Resource Languages -- the Case of Amharic Language
by: Yeshambel, Tilahun, et al.
Published: (2025)

Introducing TrGLUE and SentiTurca: A Comprehensive Benchmark for Turkish General Language Understanding and Sentiment Analysis
by: Altinok, Duygu
Published: (2025)

FormosanBench: Benchmarking Low-Resource Austronesian Languages in the Era of Large Language Models
by: Lin, Kaiying Kevin, et al.
Published: (2025)

Plutus: Benchmarking Large Language Models in Low-Resource Greek Finance
by: Peng, Xueqing, et al.
Published: (2025)

Setting Standards in Turkish NLP: TR-MMLU for Large Language Model Evaluation
by: Bayram, M. Ali, et al.
Published: (2024)

Adapting Small Language Models to Low-Resource Domains: A Case Study in Hindi Tourism QA
by: Majhi, Sandipan, et al.
Published: (2025)

A Hybrid Protocol for Large-Scale Semantic Dataset Generation in Low-Resource Languages: The Turkish Semantic Relations Corpus
by: Tosun, Ebubekir, et al.
Published: (2026)

Investigating Neural Machine Translation for Low-Resource Languages: Using Bavarian as a Case Study
by: Her, Wan-Hua, et al.
Published: (2024)

Diacritic Restoration for Low-Resource Indigenous Languages: Case Study with Bribri and Cook Islands Māori
by: Coto-Solano, Rolando, et al.
Published: (2025)

Instructing Large Language Models for Low-Resource Languages: A Systematic Study for Basque
by: Sainz, Oscar, et al.
Published: (2025)

Fine-tuning Transformer-based Encoder for Turkish Language Understanding Tasks
by: Yildirim, Savas
Published: (2024)

Testing Low-Resource Language Support in LLMs Using Language Proficiency Exams: the Case of Luxembourgish
by: Lothritz, Cedric, et al.
Published: (2025)

Toxicity Red-Teaming: Benchmarking LLM Safety in Singapore's Low-Resource Languages
by: Hu, Yujia, et al.
Published: (2025)

Can LLMs Faithfully Explain Themselves in Low-Resource Languages? A Case Study on Emotion Detection in Persian
by: Mehrazar, Mobina, et al.
Published: (2025)

Low-Resource Dialect Adaptation of Large Language Models: A French Dialect Case-Study
by: Khan, Eeham, et al.
Published: (2025)

Instruction Tuning on Public Government and Cultural Data for Low-Resource Language: a Case Study in Kazakh
by: Laiyk, Nurkhan, et al.
Published: (2025)