Counterfactual-Consistency Prompting for Relative Temporal Understanding in Large Language Models

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Kim, Jongho, Hwang, Seung-won
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913897463676928
author Kim, Jongho
Hwang, Seung-won
author_facet Kim, Jongho
Hwang, Seung-won
contents Despite the advanced capabilities of large language models (LLMs), their temporal reasoning ability remains underdeveloped. Prior works have highlighted this limitation, particularly in maintaining temporal consistency when understanding events. For example, models often confuse mutually exclusive temporal relations like ``before'' and ``after'' between events and make inconsistent predictions. In this work, we tackle the issue of temporal inconsistency in LLMs by proposing a novel counterfactual prompting approach. Our method generates counterfactual questions and enforces collective constraints, enhancing the model's consistency. We evaluate our method on multiple datasets, demonstrating significant improvements in event ordering for explicit and implicit events and temporal commonsense understanding by effectively addressing temporal inconsistencies.
format Preprint
id arxiv_https___arxiv_org_abs_2502_11425
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Counterfactual-Consistency Prompting for Relative Temporal Understanding in Large Language Models
Kim, Jongho
Hwang, Seung-won
Computation and Language
Artificial Intelligence
Despite the advanced capabilities of large language models (LLMs), their temporal reasoning ability remains underdeveloped. Prior works have highlighted this limitation, particularly in maintaining temporal consistency when understanding events. For example, models often confuse mutually exclusive temporal relations like ``before'' and ``after'' between events and make inconsistent predictions. In this work, we tackle the issue of temporal inconsistency in LLMs by proposing a novel counterfactual prompting approach. Our method generates counterfactual questions and enforces collective constraints, enhancing the model's consistency. We evaluate our method on multiple datasets, demonstrating significant improvements in event ordering for explicit and implicit events and temporal commonsense understanding by effectively addressing temporal inconsistencies.
title Counterfactual-Consistency Prompting for Relative Temporal Understanding in Large Language Models
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2502.11425