:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Abdoli, Sajjad, Cilibrasi, Rudi, Al-Shikh, Rima
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence Computation and Language
Online Access:	https://arxiv.org/abs/2509.10707
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Towards Outcome-Oriented, Task-Agnostic Evaluation of AI Agents
by: AlShikh, Waseem, et al.
Published: (2025)

Benchmarking Commercial ASR Systems on Code-Switching Speech: Arabic, Persian, and German
by: Abdoli, Sajjad, et al.
Published: (2026)

The Qiyas Benchmark: Measuring ChatGPT Mathematical and Language Understanding in Arabic
by: Al-Khalifa, Shahad, et al.
Published: (2024)

Assessing and Understanding Creativity in Large Language Models
by: Zhao, Yunpu, et al.
Published: (2024)

Evaluating Semantic and Syntactic Understanding in Large Language Models for Payroll Systems
by: Maclean, Hendrika, et al.
Published: (2026)

How Different AI Chatbots Behave? Benchmarking Large Language Models in Behavioral Economics Games
by: Xie, Yutong, et al.
Published: (2024)

JEEM: Vision-Language Understanding in Four Arabic Dialects
by: Kadaoui, Karima, et al.
Published: (2025)

Quantifying Label-Induced Bias in Large Language Model Self- and Cross-Evaluations
by: Saraf, Muskan, et al.
Published: (2025)

Evaluating Text Summaries Generated by Large Language Models Using OpenAI's GPT
by: Shakil, Hassan, et al.
Published: (2024)

Putting GPT-4o to the Sword: A Comprehensive Evaluation of Language, Vision, Speech, and Multimodal Proficiency
by: Shahriar, Sakib, et al.
Published: (2024)

A Cognitive Evaluation Benchmark of Image Reasoning and Description for Large Vision-Language Models
by: Song, Xiujie, et al.
Published: (2024)

BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Tasks
by: Zhang, Kai, et al.
Published: (2023)

TALE: A Tool-Augmented Framework for Reference-Free Evaluation of Large Language Models
by: Badshah, Sher, et al.
Published: (2025)

Developing a Pragmatic Benchmark for Assessing Korean Legal Language Understanding in Large Language Models
by: Kim, Yeeun, et al.
Published: (2024)

Assessing the Quality of AI-Generated Clinical Notes: A Validated Evaluation of a Large Language Model Scribe
by: Palm, Erin, et al.
Published: (2025)

Evaluating Spatial Understanding of Large Language Models
by: Yamada, Yutaro, et al.
Published: (2023)

AI and the Law: Evaluating ChatGPT's Performance in Legal Classification
by: Weichbroth, Pawel
Published: (2025)

Peer-Ranked Precision: Creating a Foundational Dataset for Fine-Tuning Vision Models from DataSeeds' Annotated Imagery
by: Abdoli, Sajjad, et al.
Published: (2025)

ALLaVA: Harnessing GPT4V-Synthesized Data for Lite Vision-Language Models
by: Chen, Guiming Hardy, et al.
Published: (2024)

Number Cookbook: Number Understanding of Language Models and How to Improve It
by: Yang, Haotong, et al.
Published: (2024)

Can GPT Redefine Medical Understanding? Evaluating GPT on Biomedical Machine Reading Comprehension
by: Vatsal, Shubham, et al.
Published: (2024)

ArabLegalEval: A Multitask Benchmark for Assessing Arabic Legal Knowledge in Large Language Models
by: Hijazi, Faris, et al.
Published: (2024)

From Local Concepts to Universals: Evaluating the Multicultural Understanding of Vision-Language Models
by: Bhatia, Mehar, et al.
Published: (2024)

"Understanding AI": Semantic Grounding in Large Language Models
by: Lyre, Holger
Published: (2024)

Assessing Personalized AI Mentoring with Large Language Models in the Computing Field
by: Luo, Xiao, et al.
Published: (2024)

From Superficial Patterns to Semantic Understanding: Fine-Tuning Language Models on Contrast Sets
by: Petrov, Daniel
Published: (2025)

Coding Triangle: How Does Large Language Model Understand Code?
by: Zhang, Taolin, et al.
Published: (2025)

Evaluating ChatGPT-4 Vision on Brazil's National Undergraduate Computer Science Exam
by: Mendonça, Nabor C.
Published: (2024)

Multilingual Training and Evaluation Resources for Vision-Language Models
by: Baiamonte, Daniela, et al.
Published: (2026)

Benchmarking Vision Language Models for Cultural Understanding
by: Nayak, Shravan, et al.
Published: (2024)

The Arabic AI Fingerprint: Stylometric Analysis and Detection of Large Language Models Text
by: Al-Shaibani, Maged S., et al.
Published: (2025)

WER is Unaware: Assessing How ASR Errors Distort Clinical Understanding in Patient Facing Dialogue
by: Ellis, Zachary, et al.
Published: (2025)

GPT and Prejudice: A Sparse Approach to Understanding Learned Representations in Large Language Models
by: Mahran, Mariam, et al.
Published: (2025)

NepaliGPT: A Generative Language Model for the Nepali Language
by: Pudasaini, Shushanta, et al.
Published: (2025)

The Pluralistic Moral Gap: Understanding Judgment and Value Differences between Humans and Large Language Models
by: Russo, Giuseppe, et al.
Published: (2025)

GPT-SW3: An Autoregressive Language Model for the Nordic Languages
by: Ekgren, Ariel, et al.
Published: (2023)

Metamorphic Testing for Fairness Evaluation in Large Language Models: Identifying Intersectional Bias in LLaMA and GPT
by: Reddy, Harishwar, et al.
Published: (2025)

Attributional Safety Failures in Large Language Models under Code-Mixed Perturbations
by: Banerjee, Somnath, et al.
Published: (2025)

MobileVLM: A Vision-Language Model for Better Intra- and Inter-UI Understanding
by: Wu, Qinzhuo, et al.
Published: (2024)

Knowing the Facts but Choosing the Shortcut: Understanding How Large Language Models Compare Entities
by: Lehmann, Hans Hergen, et al.
Published: (2025)