T-T: Table Transformer for Tagging-based Aspect Sentiment Triplet Extraction

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Peng, Kun, Tong, Chaodong, Cao, Cong, Peng, Hao, Li, Qian, Wu, Guanlin, Jiang, Lei, Liu, Yanbing, Yu, Philip S.
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913826762391552
author Peng, Kun
Tong, Chaodong
Cao, Cong
Peng, Hao
Li, Qian
Wu, Guanlin
Jiang, Lei
Liu, Yanbing
Yu, Philip S.
author_facet Peng, Kun
Tong, Chaodong
Cao, Cong
Peng, Hao
Li, Qian
Wu, Guanlin
Jiang, Lei
Liu, Yanbing
Yu, Philip S.
contents Aspect sentiment triplet extraction (ASTE) aims to extract triplets composed of aspect terms, opinion terms, and sentiment polarities from given sentences. The table tagging method is a popular approach to addressing this task, which encodes a sentence into a 2-dimensional table, allowing for the tagging of relations between any two words. Previous efforts have focused on designing various downstream relation learning modules to better capture interactions between tokens in the table, revealing that a stronger capability to capture relations can lead to greater improvements in the model. Motivated by this, we attempt to directly utilize transformer layers as downstream relation learning modules. Due to the powerful semantic modeling capability of transformers, it is foreseeable that this will lead to excellent improvement. However, owing to the quadratic relation between the length of the table and the length of the input sentence sequence, using transformers directly faces two challenges: overly long table sequences and unfair local attention interaction. To address these challenges, we propose a novel Table-Transformer (T-T) for the tagging-based ASTE method. Specifically, we introduce a stripe attention mechanism with a loop-shift strategy to tackle these challenges. The former modifies the global attention mechanism to only attend to a 2-dimensional local attention window, while the latter facilitates interaction between different attention windows. Extensive and comprehensive experiments demonstrate that the T-T, as a downstream relation learning module, achieves state-of-the-art performance with lower computational costs.
format Preprint
id arxiv_https___arxiv_org_abs_2505_05271
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle T-T: Table Transformer for Tagging-based Aspect Sentiment Triplet Extraction
Peng, Kun
Tong, Chaodong
Cao, Cong
Peng, Hao
Li, Qian
Wu, Guanlin
Jiang, Lei
Liu, Yanbing
Yu, Philip S.
Computation and Language
Artificial Intelligence
Aspect sentiment triplet extraction (ASTE) aims to extract triplets composed of aspect terms, opinion terms, and sentiment polarities from given sentences. The table tagging method is a popular approach to addressing this task, which encodes a sentence into a 2-dimensional table, allowing for the tagging of relations between any two words. Previous efforts have focused on designing various downstream relation learning modules to better capture interactions between tokens in the table, revealing that a stronger capability to capture relations can lead to greater improvements in the model. Motivated by this, we attempt to directly utilize transformer layers as downstream relation learning modules. Due to the powerful semantic modeling capability of transformers, it is foreseeable that this will lead to excellent improvement. However, owing to the quadratic relation between the length of the table and the length of the input sentence sequence, using transformers directly faces two challenges: overly long table sequences and unfair local attention interaction. To address these challenges, we propose a novel Table-Transformer (T-T) for the tagging-based ASTE method. Specifically, we introduce a stripe attention mechanism with a loop-shift strategy to tackle these challenges. The former modifies the global attention mechanism to only attend to a 2-dimensional local attention window, while the latter facilitates interaction between different attention windows. Extensive and comprehensive experiments demonstrate that the T-T, as a downstream relation learning module, achieves state-of-the-art performance with lower computational costs.
title T-T: Table Transformer for Tagging-based Aspect Sentiment Triplet Extraction
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2505.05271