Cover Image

Syntax Is Easy, Semantics Is Hard: Evaluating LLMs for LTL Translation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Danso, Priscilla Kyei, Hasan, Mohammad Saqib, Balasubramanian, Niranjan, Chowdhury, Omar
Format:	Preprint
Published:	2026
Subjects:	Logic in Computer Science Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

NeuroNL2LTL: A Neurosymbolic Framework for Natural Language Translation of Linear Temporal Logic
by: Quansah, Paapa Kwesi, et al.
Published: (2026)

On-the-fly Synthesis for LTL over Finite Traces: An Efficient Approach that Counts
by: Xiao, Shengping, et al.
Published: (2024)

Hard Math -- Easy UVM: Pragmatic solutions for verifying hardware algorithms using UVM
by: Litterick, Mark, et al.
Published: (2024)

MULTIGAIN 2.0: MDP controller synthesis for multiple mean-payoff, LTL and steady-state constraints
by: Bals, Severin, et al.
Published: (2023)

Shield Synthesis for LTL Modulo Theories
by: Rodriguez, Andoni, et al.
Published: (2024)

On Deciding the Data Complexity of Answering Linear Monadic Datalog Queries with LTL Operators(Extended Version)
by: Artale, Alessandro, et al.
Published: (2025)

Evaluation and Comparison Semantics for ODRL
by: Salas, Jaime Osvaldo, et al.
Published: (2025)

Integrating LTL Constraints into PPO for Safe Reinforcement Learning
by: Zhang, Maifang, et al.
Published: (2026)

LTLGuard: Formalizing LTL Specifications with Compact Language Models and Lightweight Symbolic Reasoning
by: Andresel, Medina, et al.
Published: (2026)

SemML 2.0: Synthesizing Controllers for LTL
by: Křetínský, Jan, et al.
Published: (2026)

LTL$_f$ Learning Meets Boolean Set Cover
by: Bathie, Gabriel, et al.
Published: (2025)

Presburger Functional Synthesis: Complexity and Tractable Normal Forms
by: Akshay, S., et al.
Published: (2025)

First Order Logic with Fuzzy Semantics for Describing and Recognizing Nerves in Medical Images
by: Bloch, Isabelle, et al.
Published: (2025)

What is Formal Verification without Specifications? A Survey on mining LTL Specifications
by: Neider, Daniel, et al.
Published: (2025)

Do LLMs Really Struggle at NL-FOL Translation? Revealing their Strengths via a Novel Benchmarking Strategy
by: Brunello, Andrea, et al.
Published: (2025)

Extended Version of: On the Structural Hardness of Answer Set Programming: Can Structure Efficiently Confine the Power of Disjunctions?
by: Hecher, Markus, et al.
Published: (2024)

Semantic Bridges Between First Order c-Representations and Cost-Based Semantics: An Initial Perspective
by: Leisegang, Nicholas, et al.
Published: (2025)

A Translation of Probabilistic Event Calculus into Markov Decision Processes
by: Xu, Lyris, et al.
Published: (2025)

Translating Informal Proofs into Formal Proofs Using a Chain of States
by: Wang, Ziyu, et al.
Published: (2025)

Satisfiability Solving with LLMs: A Matched-Pair Evaluation of Reasoning Capability
by: Zhang, Leizhen, et al.
Published: (2026)

On the Trap Space Semantics of Normal Logic Programs
by: Trinh, Van-Giang, et al.
Published: (2026)

Weighted Rules under the Stable Model Semantics
by: Lee, Joohyung, et al.
Published: (2026)

On the Complexity of the Grounded Semantics for Infinite Argumentation Frameworks
by: Andrews, Uri, et al.
Published: (2025)

Knowledge Base Embeddings: Semantics and Theoretical Properties
by: Bourgaux, Camille, et al.
Published: (2024)

Dissecting Logical Reasoning in LLMs: A Fine-Grained Evaluation and Supervision Study
by: Zhou, Yujun, et al.
Published: (2025)

SHACL Validation in the Presence of Ontologies: Semantics and Rewriting Techniques
by: Oudshoorn, Anouk, et al.
Published: (2025)

Teaching and Evaluating LLMs to Reason About Polymer Design Related Tasks
by: Mohanty, Dikshya, et al.
Published: (2026)

interwhen: A Generalizable Framework for Steering Reasoning Models with Test-time Verification
by: Bhat, Vishak K, et al.
Published: (2026)

A New Tractable Description Logic under Categorical Semantics
by: Duc, Chan Le, et al.
Published: (2025)

Ensuring Logic in the Fog: Sound POMDP Synthesis with LTL Objectives
by: Zhou, Can, et al.
Published: (2026)

Useful Evaluation: Syntax and Semantics (Technical Report)
by: Barenbaum, Pablo, et al.
Published: (2024)

Formally Verified Certification of Unsolvability of Temporal Planning Problems
by: Wang, David, et al.
Published: (2025)

Formally Verified Approximate Policy Iteration
by: Schäffeler, Maximilian, et al.
Published: (2024)

Automated Process Planning Based on a Semantic Capability Model and SMT
by: Köcher, Aljosha, et al.
Published: (2023)

A Remark on the Expressivity of Asynchronous TeamLTL and HyperLTL
by: Kontinen, Juha, et al.
Published: (2024)

Probabilistic Circuits for Knowledge Graph Completion with Reduced Rule Sets
by: Patil, Jaikrishna Manojkumar, et al.
Published: (2025)

Recursive Aggregates as Intensional Functions in Answer Set Programming: Semantics and Strong Equivalence
by: Fandinno, Jorge, et al.
Published: (2024)

Stress-Testing the Reasoning Competence of LLMs With Proofs Under Minimal Formalism
by: Arkoudas, Konstantine, et al.
Published: (2026)

Finding Cut-Offs in Leaderless Rendez-Vous Protocols is Easy
by: Balasubramanian, A. R., et al.
Published: (2020)

Defeasible Conditional Obligation in a Two-tiered Preference-based Semantics (Extended Version)
by: Parent, Xavier
Published: (2026)