Cover Image

BIS Reasoning 1.0: The First Large-Scale Japanese Benchmark for Belief-Inconsistent Syllogistic Reasoning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Nguyen, Ha-Thanh, Tachibana, Hideyuki, Liu, Chaoran, Liu, Qianying, Noe, Su Myat, Takeda, Koichi, Kurohashi, Sadao
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Reasoning Depth and Environment Complexity: A Controlled Study of RLVR Data Allocation across Logical Reasoning Tasks
by: Zhu, Yihua, et al.
Published: (2026)

Assessing Agentic Large Language Models in Multilingual National Bias
by: Liu, Qianying, et al.
Published: (2025)

Memorization, Emergence, and Explaining Reversal Failures: A Controlled Study of Relational Semantics in LLMs
by: Zhu, Yihua, et al.
Published: (2026)

Mechanistic Diagnostics of Spatial Lexical Bias in Multimodal Large Language Model Spatial Reasoning
by: Ma, Chuang, et al.
Published: (2026)

Language Lives in Sparse Dimensions: Toward Interpretable and Efficient Multilingual Control for Large Language Models
by: Zhong, Chengzhi, et al.
Published: (2025)

RecMind: Japanese Movie Recommendation Dialogue with Seeker's Internal State
by: Kodama, Takashi, et al.
Published: (2024)

EMS: Efficient and Effective Massively Multilingual Sentence Embedding Learning
by: Mao, Zhuoyuan, et al.
Published: (2022)

A Joint Neural Baseline for Concept, Assertion, and Relation Extraction from Clinical Text
by: Cheng, Fei, et al.
Published: (2026)

Rapidly Developing High-quality Instruction Data and Evaluation Benchmark for Large Language Models with Minimal Human Effort: A Case Study on Japanese
by: Sun, Yikun, et al.
Published: (2024)

Beyond English-Centric LLMs: What Language Do Multilingual Language Models Think in?
by: Zhong, Chengzhi, et al.
Published: (2024)

Abductive Reasoning with Syllogistic Forms in Large Language Models
by: Abe, Hirohiko, et al.
Published: (2026)

PYTHEN: A Flexible Framework for Legal Reasoning in Python
by: Nguyen, Ha-Thanh, et al.
Published: (2026)

Hybrid Models for Natural Language Reasoning: The Case of Syllogistic Logic
by: Guzmán, Manuel Vargas, et al.
Published: (2025)

A Systematic Comparison of Syllogistic Reasoning in Humans and Language Models
by: Eisape, Tiwalayo, et al.
Published: (2023)

An Explicit Syllogistic Legal Reasoning Framework for Large Language Models
by: Zhang, Kepu, et al.
Published: (2025)

Reasoning Circuits in Language Models: A Mechanistic Interpretation of Syllogistic Inference
by: Kim, Geonhee, et al.
Published: (2024)

Understanding Syllogistic Reasoning in LLMs from Formal and Natural Language Perspectives
by: Poddar, Aheli, et al.
Published: (2025)

J-CRe3: A Japanese Conversation Dataset for Real-world Reference Resolution
by: Ueda, Nobuhiro, et al.
Published: (2024)

Multimodal Inconsistency Reasoning (MMIR): A New Benchmark for Multimodal Reasoning Models
by: Yan, Qianqi, et al.
Published: (2025)

Topology Matters: A Cautionary Case Study of Graph SSL on Neuro-Inspired Benchmarks
by: Carlon, May Kristine Jonson, et al.
Published: (2026)

SylloBio-NLI: Evaluating Large Language Models on Biomedical Syllogistic Reasoning
by: Wysocka, Magdalena, et al.
Published: (2024)

A Syllogistic Probe: Tracing the Evolution of Logic Reasoning in Large Language Models
by: Zang, Zhengqing, et al.
Published: (2026)

Reformulating Domain Adaptation of Large Language Models as Adapt-Retrieve-Revise: A Case Study on Chinese Legal Domain
by: wan, Zhen, et al.
Published: (2023)

Data Augmented Pipeline for Legal Information Extraction and Reasoning
by: Phuong, Nguyen Minh, et al.
Published: (2026)

Proceedings of the First International Workshop on Next-Generation Language Models for Knowledge Representation and Reasoning (NeLaMKRR 2024)
by: Satoh, Ken, et al.
Published: (2024)

The Syllogistic with Unity
by: Pratt-Hartmann, Ian
Published: (2011)

The Hamiltonian Syllogistic
by: Pratt-Hartmann, Ian
Published: (2010)

A Systematic Analysis of Large Language Models as Soft Reasoners: The Case of Syllogistic Inferences
by: Bertolazzi, Leonardo, et al.
Published: (2024)

SR-FoT: A Syllogistic-Reasoning Framework of Thought for Large Language Models Tackling Knowledge-based Reasoning Tasks
by: Wan, Wentao, et al.
Published: (2025)

Logics for the Relational Syllogistic
by: Pratt-Hartmann, Ian, et al.
Published: (2008)

An Embedding-based Approach to Inconsistency-tolerant Reasoning with Inconsistent Ontologies
by: Wang, Keyu, et al.
Published: (2023)

Reading Comprehension using Entity-based Memory Network
by: Wang, Xun, et al.
Published: (2016)

Causal Tree Extraction from Medical Case Reports: A Novel Task for Experts-like Text Comprehension
by: Yahata, Sakiko, et al.
Published: (2025)

Argumentative Reasoning with Language Models on Non-factorized Case Bases
by: Fungwacharakorn, Wachara, et al.
Published: (2025)

UFAL-CUNI at SemEval-2026 Task 11: An Efficient Modular Neuro-symbolic Method for Syllogistic Reasoning
by: Kartáč, Ivan, et al.
Published: (2026)

AcTED: Automatic Acquisition of Typical Event Duration for Semi-supervised Temporal Commonsense QA
by: Virgo, Felix, et al.
Published: (2024)

MMLU-Reason: Benchmarking Multi-Task Multi-modal Language Understanding and Reasoning
by: Tie, Guiyao, et al.
Published: (2025)

Reasoning about concepts with LLMs: Inconsistencies abound
by: Uceda-Sosa, Rosario, et al.
Published: (2024)

Exploiting LLMs' Reasoning Capability to Infer Implicit Concepts in Legal Information Retrieval
by: Nguyen, Hai-Long, et al.
Published: (2024)

Diagnosing and Mitigating Semantic Inconsistencies in Wikidata's Classification Hierarchy
by: Zhao, Shixiong, et al.
Published: (2025)