Cover Image

SylloBio-NLI: Evaluating Large Language Models on Biomedical Syllogistic Reasoning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wysocka, Magdalena, Carvalho, Danilo, Wysocki, Oskar, Valentino, Marco, Freitas, Andre
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

An LLM-based Knowledge Synthesis and Scientific Reasoning Framework for Biomedical Discovery
by: Wysocki, Oskar, et al.
Published: (2024)

Large Language Models, scientific knowledge and factuality: A framework to streamline human expert evaluation
by: Wysocka, Magdalena, et al.
Published: (2023)

Reasoning Circuits in Language Models: A Mechanistic Interpretation of Syllogistic Inference
by: Kim, Geonhee, et al.
Published: (2024)

Accelerating Antibiotic Discovery with Large Language Models and Knowledge Graphs
by: Delmas, Maxime, et al.
Published: (2025)

Estimating the Causal Effects of Natural Logic Features in Neural NLI Models
by: Rozanova, Julia, et al.
Published: (2023)

Estimating the Causal Effects of Natural Logic Features in Transformer-Based NLI Models
by: Rozanova, Julia, et al.
Published: (2024)

Learning to Disentangle Latent Reasoning Rules with Language VAEs: A Systematic Study
by: Zhang, Yingji, et al.
Published: (2025)

Integrating Expert Knowledge into Logical Programs via LLMs
by: Górski, Franciszek, et al.
Published: (2025)

Multi-Relational Hyperbolic Word Embeddings from Natural Language Definitions
by: Valentino, Marco, et al.
Published: (2023)

Biomedical reasoning in action: Multi-agent System for Auditable Biomedical Evidence Synthesis
by: Wysocki, Oskar, et al.
Published: (2025)

Controlling Equational Reasoning in Large Language Models with Prompt Interventions
by: Meadows, Jordan, et al.
Published: (2023)

Reasoning with Natural Language Explanations
by: Valentino, Marco, et al.
Published: (2024)

Faithful and Robust LLM-Driven Theorem Proving for NLI Explanations
by: Quan, Xin, et al.
Published: (2025)

SemEval-2024 Task 2: Safe Biomedical Natural Language Inference for Clinical Trials
by: Jullien, Mael, et al.
Published: (2024)

An Explicit Syllogistic Legal Reasoning Framework for Large Language Models
by: Zhang, Kepu, et al.
Published: (2025)

Abductive Reasoning with Syllogistic Forms in Large Language Models
by: Abe, Hirohiko, et al.
Published: (2026)

EconNLI: Evaluating Large Language Models on Economics Reasoning
by: Guo, Yue, et al.
Published: (2024)

PEIRCE: Unifying Material and Formal Reasoning via LLM-Driven Neuro-Symbolic Refinement
by: Quan, Xin, et al.
Published: (2025)

Eliciting Critical Reasoning in Retrieval-Augmented Language Models via Contrastive Explanations
by: Ranaldi, Leonardo, et al.
Published: (2024)

Logic-Parametric Neuro-Symbolic NLI: Controlling Logical Formalisms for Verifiable LLM Reasoning
by: Farjami, Ali, et al.
Published: (2026)

Dissecting Clinical Reasoning in Language Models: A Comparative Study of Prompts and Model Adaptation Strategies
by: Jullien, Mael, et al.
Published: (2025)

A Systematic Analysis of Large Language Models as Soft Reasoners: The Case of Syllogistic Inferences
by: Bertolazzi, Leonardo, et al.
Published: (2024)

Improving Chain-of-Thought Reasoning via Quasi-Symbolic Abstractions
by: Ranaldi, Leonardo, et al.
Published: (2025)

Beyond Gold Standards: Epistemic Ensemble of LLM Judges for Formal Mathematical Reasoning
by: Zhang, Lan, et al.
Published: (2025)

Enhancing Ethical Explanations of Large Language Models through Iterative Symbolic Refinement
by: Quan, Xin, et al.
Published: (2024)

A Symbolic Framework for Evaluating Mathematical Reasoning and Generalisation with Transformers
by: Meadows, Jordan, et al.
Published: (2023)

Improving Semantic Control in Discrete Latent Spaces with Transformer Quantized Variational Autoencoders
by: Zhang, Yingji, et al.
Published: (2024)

Inference to the Best Explanation in Large Language Models
by: Dalal, Dhairya, et al.
Published: (2024)

Hybrid Models for Natural Language Reasoning: The Case of Syllogistic Logic
by: Guzmán, Manuel Vargas, et al.
Published: (2025)

TRACE: Training and Inference-Time Interpretability Analysis for Language Models
by: Aljaafari, Nura, et al.
Published: (2025)

Mitigating Content Effects on Reasoning in Language Models through Fine-Grained Activation Steering
by: Valentino, Marco, et al.
Published: (2025)

A Systematic Comparison of Syllogistic Reasoning in Humans and Language Models
by: Eisape, Tiwalayo, et al.
Published: (2023)

Adaptive LLM-Symbolic Reasoning via Dynamic Logical Solver Composition
by: Xu, Lei, et al.
Published: (2025)

Rethinking STS and NLI in Large Language Models
by: Wang, Yuxia, et al.
Published: (2023)

SR-FoT: A Syllogistic-Reasoning Framework of Thought for Large Language Models Tackling Knowledge-based Reasoning Tasks
by: Wan, Wentao, et al.
Published: (2025)

Compartmentalised Agentic Reasoning for Clinical NLI
by: Jullien, Maël, et al.
Published: (2025)

Inferring Latent Intentions: Attributional Natural Language Inference in LLM Agents
by: Quan, Xin, et al.
Published: (2026)

A Differentiable Integer Linear Programming Solver for Explanation-Based Natural Language Inference
by: Thayaparan, Mokanarangan, et al.
Published: (2024)

The Mechanics of Conceptual Interpretation in GPT Models: Interpretative Insights
by: Aljaafari, Nura, et al.
Published: (2024)

Monotonic Reference-Free Refinement for Autoformalization
by: Zhang, Lan, et al.
Published: (2026)