Guardado en:
Detalles Bibliográficos
Autores principales: Liu, Jiaxin, Yang, Yi, Tam, Kar Yan
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:https://arxiv.org/abs/2403.14341
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910377768386560
author Liu, Jiaxin
Yang, Yi
Tam, Kar Yan
author_facet Liu, Jiaxin
Yang, Yi
Tam, Kar Yan
contents In this paper, we introduce the Financial-STS task, a financial domain-specific NLP task designed to measure the nuanced semantic similarity between pairs of financial narratives. These narratives originate from the financial statements of the same company but correspond to different periods, such as year-over-year comparisons. Measuring the subtle semantic differences between these paired narratives enables market stakeholders to gauge changes over time in the company's financial and operational situations, which is critical for financial decision-making. We find that existing pretrained embedding models and LLM embeddings fall short in discerning these subtle financial narrative shifts. To address this gap, we propose an LLM-augmented pipeline specifically designed for the Financial-STS task. Evaluation on a human-annotated dataset demonstrates that our proposed method outperforms existing methods trained on classic STS tasks and generic LLM embeddings.
format Preprint
id arxiv_https___arxiv_org_abs_2403_14341
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Beyond Surface Similarity: Detecting Subtle Semantic Shifts in Financial Narratives
Liu, Jiaxin
Yang, Yi
Tam, Kar Yan
Computation and Language
In this paper, we introduce the Financial-STS task, a financial domain-specific NLP task designed to measure the nuanced semantic similarity between pairs of financial narratives. These narratives originate from the financial statements of the same company but correspond to different periods, such as year-over-year comparisons. Measuring the subtle semantic differences between these paired narratives enables market stakeholders to gauge changes over time in the company's financial and operational situations, which is critical for financial decision-making. We find that existing pretrained embedding models and LLM embeddings fall short in discerning these subtle financial narrative shifts. To address this gap, we propose an LLM-augmented pipeline specifically designed for the Financial-STS task. Evaluation on a human-annotated dataset demonstrates that our proposed method outperforms existing methods trained on classic STS tasks and generic LLM embeddings.
title Beyond Surface Similarity: Detecting Subtle Semantic Shifts in Financial Narratives
topic Computation and Language
url https://arxiv.org/abs/2403.14341