Cover Image

Irish-BLiMP: A Linguistic Benchmark for Evaluating Human and Language Model Performance in a Low-Resource Setting

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	McGiff, Josh, Tran, Khanh-Tung, Mulcahy, William, Luinín, Dáibhidh Ó, Dalzell, Jake, Bhroin, Róisín Ní, Burke, Adam, O'Sullivan, Barry, Nguyen, Hoang D., Nikolov, Nikola S.
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

SemiAdapt and SemiLoRA: Efficient Domain Adaptation for Transformer-based Low-Resource Language Translation with a Case Study on Irish
by: McGiff, Josh, et al.
Published: (2025)

Overcoming Data Scarcity in Generative Language Modelling for Low-Resource Languages: A Systematic Review
by: McGiff, Josh, et al.
Published: (2025)

Bridging the gap in online hate speech detection: a comparative analysis of BERT and traditional models for homophobic content identification on X/Twitter
by: McGiff, Josh, et al.
Published: (2024)

UCCIX: Irish-eXcellence Large Language Model
by: Tran, Khanh-Tung, et al.
Published: (2024)

IRLBench: A Multi-modal, Culturally Grounded, Parallel Irish-English Benchmark for Open-Ended LLM Reasoning Evaluation
by: Tran, Khanh-Tung, et al.
Published: (2025)

Reasoning Transfer for an Extremely Low-Resource and Endangered Language: Bridging Languages Through Sample-Efficient Language Understanding
by: Tran, Khanh-Tung, et al.
Published: (2025)

RuBLiMP: Russian Benchmark of Linguistic Minimal Pairs
by: Taktasheva, Ekaterina, et al.
Published: (2024)

Towards Utilising a Range of Neural Activations for Comprehending Representational Associations
by: O'Mahony, Laura, et al.
Published: (2024)

On the Detection of Anomalous or Out-Of-Distribution Data in Vision Models Using Statistical Techniques
by: O'Mahony, Laura, et al.
Published: (2024)

TurBLiMP: A Turkish Benchmark of Linguistic Minimal Pairs
by: Başar, Ezgi, et al.
Published: (2025)

QFrBLiMP: a Quebec-French Benchmark of Linguistic Minimal Pairs
by: Beauchemin, David, et al.
Published: (2025)

UrBLiMP: A Benchmark for Evaluating the Linguistic Competence of Large Language Models in Urdu
by: Adeeba, Farah, et al.
Published: (2025)

MultiBLiMP 1.0: A Massively Multilingual Benchmark of Linguistic Minimal Pairs
by: Jumelet, Jaap, et al.
Published: (2025)

Multi-Agent Collaboration Mechanisms: A Survey of LLMs
by: Tran, Khanh-Tung, et al.
Published: (2025)

Monkey Business
by: O'Sullivan, Connie, et al.
Published: (2005)

“You go in heavy and you come out light”: An interpretative phenomenological analysis of reflective practice experiences in an Irish infant mental health setting
by: Mary Tobin, et al.
Published: (2024)

Finding polarised communities and tracking information diffusion on Twitter: The Irish Abortion Referendum
by: Pena, Caroline, et al.
Published: (2023)

Questionnaire meets LLM: A Benchmark and Empirical Study of Structural Skills for Understanding Questions and Responses
by: Nguyen, Duc-Hai, et al.
Published: (2025)

Refined Iterated Pareto Greedy for Energy-aware Hybrid Flowshop Scheduling with Blocking Constraints
by: Missaoui, Ahmed, et al.
Published: (2025)

Enhancing coastal water body segmentation with Landsat Irish Coastal Segmentation (LICS) dataset
by: O'Sullivan, Conor, et al.
Published: (2024)

Qomhra: A Bilingual Irish and English Large Language Model
by: McInerney, Joseph, et al.
Published: (2025)

Concrete Expressions
by: O'Sullivan, Kevin
Published: (2018)

'We Are All Here to Stay'
by: O'Sullivan, Dominic
Published: (2020)

Reimagining Homelessness
by: O'Sullivan, Eoin
Published: (2020)

Progressive realism
by: Olivia O'Sullivan
Published: (2024)

Integer continued fractions for complex numbers
by: O'Sullivan, Cormac
Published: (2025)

Topographs for binary quadratic forms and class numbers
by: O'Sullivan, Cormac
Published: (2024)

Machine learning enhanced virtual autopsy
by: Shane O’Sullivan
Published: (2017)

Shipboard acoustic doppler current profiling during cruise PS9910 (SAC ID 00448)
by: O'Sullivan, J
Published: (2005)

Topographs for binary quadratic forms and class numbers
by: Cormac O'Sullivan
Published: (2025)

From Decoding to Understanding: Building Background Knowledge and Inferencing Skills in Early Readers
by: Jen O'Sullivan
Published: (2025)

Considerations when devising a protocol for pre-eclampsia
by: Geraldine O’Sullivan
Published: (2012)

Virtual autopsy: Machine Learning and AI provide new opportunities for investigating minimal tumor burden and therapy resistance by cancer patients
by: Shane O’Sullivan
Published: (2018)

Computation and Complexity of Preference Inference Based on Hierarchical Models
by: Wilson, Nic, et al.
Published: (2024)

Towards Fast Algorithms for the Preference Consistency Problem Based on Hierarchical Models
by: George, Anne-Marie, et al.
Published: (2024)

The Continued Case for Bibliographical Teaching Collections
by: O'Sullivan, Kevin M.
Published: (2020)

Relato de un verano / Patricia Reilly Giff ; traducción, Alejandro Valero
by: Reilly Giff, Patricia

Longitudinal Analysis of Fluoride Levels in Irish Water Supplies: A 52‐Year Review
by: Vinay Sharma, et al.
Published: (2026)

Component parts of the World Heat Flow Data Collection
by: Hu, Shengbiao, et al.
Published: (2001)

UXR PoV for Neuroinclusive Emotion Regulation
by: Akca, Melike, et al.
Published: (2026)