Bridging LLMs and Symbolic Reasoning in Educational QA Systems: Insights from the XAI Challenge at IJCNN 2025

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Nguyen, Long S. T., Vo, Khang H. N., Nguyen, Thu H. A., Bui, Tuan C., Nguyen, Duc Q., Tran, Thanh-Tung, Nguyen, Anh D., Nguyen, Minh L., Baldacci, Fabien, Bui, Thang H., Di Nardo, Emanuel, Ciaramella, Angelo, Le, Son H., Ullah, Ihsan, Di Rocco, Lorenzo, Quan, Tho T.
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916881911250944
author Nguyen, Long S. T.
Vo, Khang H. N.
Nguyen, Thu H. A.
Bui, Tuan C.
Nguyen, Duc Q.
Tran, Thanh-Tung
Nguyen, Anh D.
Nguyen, Minh L.
Baldacci, Fabien
Bui, Thang H.
Di Nardo, Emanuel
Ciaramella, Angelo
Le, Son H.
Ullah, Ihsan
Di Rocco, Lorenzo
Quan, Tho T.
author_facet Nguyen, Long S. T.
Vo, Khang H. N.
Nguyen, Thu H. A.
Bui, Tuan C.
Nguyen, Duc Q.
Tran, Thanh-Tung
Nguyen, Anh D.
Nguyen, Minh L.
Baldacci, Fabien
Bui, Thang H.
Di Nardo, Emanuel
Ciaramella, Angelo
Le, Son H.
Ullah, Ihsan
Di Rocco, Lorenzo
Quan, Tho T.
contents The growing integration of Artificial Intelligence (AI) into education has intensified the need for transparency and interpretability. While hackathons have long served as agile environments for rapid AI prototyping, few have directly addressed eXplainable AI (XAI) in real-world educational contexts. This paper presents a comprehensive analysis of the XAI Challenge 2025, a hackathon-style competition jointly organized by Ho Chi Minh City University of Technology (HCMUT) and the International Workshop on Trustworthiness and Reliability in Neurosymbolic AI (TRNS-AI), held as part of the International Joint Conference on Neural Networks (IJCNN 2025). The challenge tasked participants with building Question-Answering (QA) systems capable of answering student queries about university policies while generating clear, logic-based natural language explanations. To promote transparency and trustworthiness, solutions were required to use lightweight Large Language Models (LLMs) or hybrid LLM-symbolic systems. A high-quality dataset was provided, constructed via logic-based templates with Z3 validation and refined through expert student review to ensure alignment with real-world academic scenarios. We describe the challenge's motivation, structure, dataset construction, and evaluation protocol. Situating the competition within the broader evolution of AI hackathons, we argue that it represents a novel effort to bridge LLMs and symbolic reasoning in service of explainability. Our findings offer actionable insights for future XAI-centered educational systems and competitive research initiatives.
format Preprint
id arxiv_https___arxiv_org_abs_2508_01263
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Bridging LLMs and Symbolic Reasoning in Educational QA Systems: Insights from the XAI Challenge at IJCNN 2025
Nguyen, Long S. T.
Vo, Khang H. N.
Nguyen, Thu H. A.
Bui, Tuan C.
Nguyen, Duc Q.
Tran, Thanh-Tung
Nguyen, Anh D.
Nguyen, Minh L.
Baldacci, Fabien
Bui, Thang H.
Di Nardo, Emanuel
Ciaramella, Angelo
Le, Son H.
Ullah, Ihsan
Di Rocco, Lorenzo
Quan, Tho T.
Computation and Language
Artificial Intelligence
Logic in Computer Science
The growing integration of Artificial Intelligence (AI) into education has intensified the need for transparency and interpretability. While hackathons have long served as agile environments for rapid AI prototyping, few have directly addressed eXplainable AI (XAI) in real-world educational contexts. This paper presents a comprehensive analysis of the XAI Challenge 2025, a hackathon-style competition jointly organized by Ho Chi Minh City University of Technology (HCMUT) and the International Workshop on Trustworthiness and Reliability in Neurosymbolic AI (TRNS-AI), held as part of the International Joint Conference on Neural Networks (IJCNN 2025). The challenge tasked participants with building Question-Answering (QA) systems capable of answering student queries about university policies while generating clear, logic-based natural language explanations. To promote transparency and trustworthiness, solutions were required to use lightweight Large Language Models (LLMs) or hybrid LLM-symbolic systems. A high-quality dataset was provided, constructed via logic-based templates with Z3 validation and refined through expert student review to ensure alignment with real-world academic scenarios. We describe the challenge's motivation, structure, dataset construction, and evaluation protocol. Situating the competition within the broader evolution of AI hackathons, we argue that it represents a novel effort to bridge LLMs and symbolic reasoning in service of explainability. Our findings offer actionable insights for future XAI-centered educational systems and competitive research initiatives.
title Bridging LLMs and Symbolic Reasoning in Educational QA Systems: Insights from the XAI Challenge at IJCNN 2025
topic Computation and Language
Artificial Intelligence
Logic in Computer Science
url https://arxiv.org/abs/2508.01263