Cover Image

OntoURL: A Benchmark for Evaluating Large Language Models on Symbolic Ontological Understanding, Reasoning and Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Xiao, Lai, Huiyuan, Meng, Qianru, Bos, Johan
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Retrieval-Augmented Semantic Parsing: Improving Generalization with Lexical Knowledge
by: Zhang, Xiao, et al.
Published: (2024)

Multidimensional Consistency Improves Reasoning in Language Models
by: Lai, Huiyuan, et al.
Published: (2025)

Neural Semantic Parsing with Extremely Rich Symbolic Meaning Representations
by: Zhang, Xiao, et al.
Published: (2024)

OntoTune: Ontology-Driven Self-training for Aligning Large Language Models
by: Liu, Zhiqiang, et al.
Published: (2025)

mCoT: Multilingual Instruction Tuning for Reasoning Consistency in Language Models
by: Lai, Huiyuan, et al.
Published: (2024)

KnowledgeBerg: Evaluating Systematic Knowledge Coverage and Compositional Reasoning in Large Language Models
by: Zhang, Xiao, et al.
Published: (2026)

BaziQA-Benchmark: Evaluating Symbolic and Temporally Compositional Reasoning in Large Language Models
by: Chen, Jiangxi, et al.
Published: (2026)

LongDocURL: a Comprehensive Multimodal Long Document Benchmark Integrating Understanding, Reasoning, and Locating
by: Deng, Chao, et al.
Published: (2024)

TACLer: Tailored Curriculum Reinforcement Learning for Efficient Reasoning
by: Lai, Huiyuan, et al.
Published: (2026)

Multi-Modal Semantic Parsing for the Interpretation of Tombstone Inscriptions
by: Zhang, Xiao, et al.
Published: (2025)

PMB5: Gaining More Insight into Neural Semantic Parsing with Challenging Benchmarks
by: Zhang, Xiao, et al.
Published: (2024)

PrOnto: Language Model Evaluations for 859 Languages
by: Gessler, Luke
Published: (2023)

Large Language Models Meet Symbolic Provers for Logical Reasoning Evaluation
by: Qi, Chengwen, et al.
Published: (2025)

OntoType: Ontology-Guided and Pre-Trained Language Model Assisted Fine-Grained Entity Typing
by: Komarlu, Tanay, et al.
Published: (2023)

Meta-Reasoning: Semantics-Symbol Deconstruction for Large Language Models
by: Wang, Yiming, et al.
Published: (2023)

DeepOnto: A Python Package for Ontology Engineering with Deep Learning
by: He, Yuan, et al.
Published: (2023)

TUBench: Benchmarking Large Vision-Language Models on Trustworthiness with Unanswerable Questions
by: He, Xingwei, et al.
Published: (2024)

OAEI-LLM: A Benchmark Dataset for Understanding Large Language Model Hallucinations in Ontology Matching
by: Qiang, Zhangcheng, et al.
Published: (2024)

In Context Learning and Reasoning for Symbolic Regression with Large Language Models
by: Sharlin, Samiha, et al.
Published: (2024)

EffiReason-Bench: A Unified Benchmark for Evaluating and Advancing Efficient Reasoning in Large Language Models
by: Huang, Junquan, et al.
Published: (2025)

SocialMaze: A Benchmark for Evaluating Social Reasoning in Large Language Models
by: Xu, Zixiang, et al.
Published: (2025)

Beyond Benchmarks: Understanding Mixture-of-Experts Models through Internal Mechanisms
by: Ying, Jiahao, et al.
Published: (2025)

Graph Reasoning Paradigm: Structured and Symbolic Reasoning with Topology-Aware Reinforcement Learning for Large Language Models
by: Liu, Runxuan, et al.
Published: (2026)

OntoAligner: A Comprehensive Modular and Robust Python Toolkit for Ontology Alignment
by: Giglou, Hamed Babaei, et al.
Published: (2025)

REBUS: A Robust Evaluation Benchmark of Understanding Symbols
by: Gritsevskiy, Andrew, et al.
Published: (2024)

Evaluating Large Language Models on the Frame and Symbol Grounding Problems: A Zero-shot Benchmark
by: Oka, Shoko
Published: (2025)

Benchmarking and Improving Large Vision-Language Models for Fundamental Visual Graph Understanding and Reasoning
by: Zhu, Yingjie, et al.
Published: (2024)

Prompt-Time Ontology-Driven Symbolic Knowledge Capture with Large Language Models
by: Çöplü, Tolga, et al.
Published: (2024)

ConInstruct: Evaluating Large Language Models on Conflict Detection and Resolution in Instructions
by: He, Xingwei, et al.
Published: (2025)

RE-IMAGINE: Symbolic Benchmark Synthesis for Reasoning Evaluation
by: Xu, Xinnuo, et al.
Published: (2025)

SymbolicThought: Integrating Language Models and Symbolic Reasoning for Consistent and Interpretable Human Relationship Understanding
by: Zhao, Runcong, et al.
Published: (2025)

Large Language Model-Enhanced Symbolic Reasoning for Knowledge Base Completion
by: He, Qiyuan, et al.
Published: (2025)

OAEI-LLM-T: A TBox Benchmark Dataset for Understanding Large Language Model Hallucinations in Ontology Matching
by: Qiang, Zhangcheng, et al.
Published: (2025)

HyperGVL: Benchmarking and Improving Large Vision-Language Models in Hypergraph Understanding and Reasoning
by: Wei, Yanbin, et al.
Published: (2026)

RUPBench: Benchmarking Reasoning Under Perturbations for Robustness Evaluation in Large Language Models
by: Wang, Yuqing, et al.
Published: (2024)

Benchmarking and Understanding Compositional Relational Reasoning of LLMs
by: Ni, Ruikang, et al.
Published: (2024)

Can Large Language Models Understand Symbolic Graphics Programs?
by: Qiu, Zeju, et al.
Published: (2024)

Seeing is Not Understanding: A Benchmark on Perception-Cognition Disparities in Large Language Models
by: Li, Haokun, et al.
Published: (2025)

End-to-End Ontology Learning with Large Language Models
by: Lo, Andy, et al.
Published: (2024)

Evaluating Large Language Models on Time Series Feature Understanding: A Comprehensive Taxonomy and Benchmark
by: Fons, Elizabeth, et al.
Published: (2024)