Table-Text Alignment: Explaining Claim Verification Against Tables in Scientific Papers
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866912589987971072 |
|---|---|
| author | Ho, Xanh Kumar, Sunisth Wu, Yun-Ang Boudin, Florian Takasu, Atsuhiro Aizawa, Akiko |
| author_facet | Ho, Xanh Kumar, Sunisth Wu, Yun-Ang Boudin, Florian Takasu, Atsuhiro Aizawa, Akiko |
| contents | Scientific claim verification against tables typically requires predicting whether a claim is supported or refuted given a table. However, we argue that predicting the final label alone is insufficient: it reveals little about the model's reasoning and offers limited interpretability. To address this, we reframe table-text alignment as an explanation task, requiring models to identify the table cells essential for claim verification. We build a new dataset by extending the SciTab benchmark with human-annotated cell-level rationales. Annotators verify the claim label and highlight the minimal set of cells needed to support their decision. After the annotation process, we utilize the collected information and propose a taxonomy for handling ambiguous cases. Our experiments show that (i) incorporating table alignment information improves claim verification performance, and (ii) most LLMs, while often predicting correct labels, fail to recover human-aligned rationales, suggesting that their predictions do not stem from faithful reasoning. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_10486 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Table-Text Alignment: Explaining Claim Verification Against Tables in Scientific Papers Ho, Xanh Kumar, Sunisth Wu, Yun-Ang Boudin, Florian Takasu, Atsuhiro Aizawa, Akiko Computation and Language Scientific claim verification against tables typically requires predicting whether a claim is supported or refuted given a table. However, we argue that predicting the final label alone is insufficient: it reveals little about the model's reasoning and offers limited interpretability. To address this, we reframe table-text alignment as an explanation task, requiring models to identify the table cells essential for claim verification. We build a new dataset by extending the SciTab benchmark with human-annotated cell-level rationales. Annotators verify the claim label and highlight the minimal set of cells needed to support their decision. After the annotation process, we utilize the collected information and propose a taxonomy for handling ambiguous cases. Our experiments show that (i) incorporating table alignment information improves claim verification performance, and (ii) most LLMs, while often predicting correct labels, fail to recover human-aligned rationales, suggesting that their predictions do not stem from faithful reasoning. |
| title | Table-Text Alignment: Explaining Claim Verification Against Tables in Scientific Papers |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2506.10486 |