ITLC at SemEval-2026 Task 11: Normalization and Deterministic Parsing for Formal Reasoning in LLMs

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Muhamad, Wicaksono Leksono, Lopo, Joanito Agili, Wong, Tack Hwa, Habibi, Muhammad Ravi Shulthan, Cahyawijaya, Samuel
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909029057429504
author Muhamad, Wicaksono Leksono
Lopo, Joanito Agili
Wong, Tack Hwa
Habibi, Muhammad Ravi Shulthan
Cahyawijaya, Samuel
author_facet Muhamad, Wicaksono Leksono
Lopo, Joanito Agili
Wong, Tack Hwa
Habibi, Muhammad Ravi Shulthan
Cahyawijaya, Samuel
contents Large language models suffer from content effects in reasoning tasks, particularly in multi-lingual contexts. We introduce a novel method that reduces these biases through explicit structural abstraction that transforms syllogisms into canonical logical representations and applies deterministic parsing to determine validity. Evaluated on the SemEval-2026 Task 11 multilingual benchmark, our approach achieves top-5 rankings across all subtasks while substantially reducing content effects and offering a competitive alternative to complex fine-tuning or activation-level interventions.
format Preprint
id arxiv_https___arxiv_org_abs_2603_02676
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle ITLC at SemEval-2026 Task 11: Normalization and Deterministic Parsing for Formal Reasoning in LLMs
Muhamad, Wicaksono Leksono
Lopo, Joanito Agili
Wong, Tack Hwa
Habibi, Muhammad Ravi Shulthan
Cahyawijaya, Samuel
Computation and Language
Artificial Intelligence
Large language models suffer from content effects in reasoning tasks, particularly in multi-lingual contexts. We introduce a novel method that reduces these biases through explicit structural abstraction that transforms syllogisms into canonical logical representations and applies deterministic parsing to determine validity. Evaluated on the SemEval-2026 Task 11 multilingual benchmark, our approach achieves top-5 rankings across all subtasks while substantially reducing content effects and offering a competitive alternative to complex fine-tuning or activation-level interventions.
title ITLC at SemEval-2026 Task 11: Normalization and Deterministic Parsing for Formal Reasoning in LLMs
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2603.02676