Mathematical Derivation Graphs: A Relation Extraction Task in STEM Manuscripts

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Prasad, Vishesh, Kim, Brian, Kani, Nickvash
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911375473770496
author Prasad, Vishesh
Kim, Brian
Kani, Nickvash
author_facet Prasad, Vishesh
Kim, Brian
Kani, Nickvash
contents Recent advances in natural language processing (NLP), particularly with the emergence of large language models (LLMs), have significantly enhanced the field of textual analysis. However, while these developments have yielded substantial progress in analyzing natural language text, applying analysis to mathematical equations and their relationships within texts has produced mixed results. This paper takes the initial steps in expanding the problem of relation extraction towards understanding the dependency relationships between mathematical expressions in STEM articles. The authors construct the Mathematical Derivation Graphs Dataset (MDGD), sourced from a random sampling of the arXiv corpus, containing an analysis of $107$ published STEM manuscripts with over $2000$ manually labeled inter-equation dependency relationships, resulting in a new object referred to as a derivation graph that summarizes the mathematical content of the manuscript. The authors exhaustively evaluate analytical and machine learning (ML) based models to assess their capability to identify and extract the derivation relationships for each article and compare the results with the ground truth. The authors show that the best tested LLMs achieve $F_1$ scores of $\sim45\%-52\%$, and attempt to improve their performance by combining them with analytic algorithms and other methods.
format Preprint
id arxiv_https___arxiv_org_abs_2410_21324
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Mathematical Derivation Graphs: A Relation Extraction Task in STEM Manuscripts
Prasad, Vishesh
Kim, Brian
Kani, Nickvash
Computation and Language
Artificial Intelligence
Machine Learning
Recent advances in natural language processing (NLP), particularly with the emergence of large language models (LLMs), have significantly enhanced the field of textual analysis. However, while these developments have yielded substantial progress in analyzing natural language text, applying analysis to mathematical equations and their relationships within texts has produced mixed results. This paper takes the initial steps in expanding the problem of relation extraction towards understanding the dependency relationships between mathematical expressions in STEM articles. The authors construct the Mathematical Derivation Graphs Dataset (MDGD), sourced from a random sampling of the arXiv corpus, containing an analysis of $107$ published STEM manuscripts with over $2000$ manually labeled inter-equation dependency relationships, resulting in a new object referred to as a derivation graph that summarizes the mathematical content of the manuscript. The authors exhaustively evaluate analytical and machine learning (ML) based models to assess their capability to identify and extract the derivation relationships for each article and compare the results with the ground truth. The authors show that the best tested LLMs achieve $F_1$ scores of $\sim45\%-52\%$, and attempt to improve their performance by combining them with analytic algorithms and other methods.
title Mathematical Derivation Graphs: A Relation Extraction Task in STEM Manuscripts
topic Computation and Language
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2410.21324