AstroMLab 5: Structured Summaries and Concept Extraction for 400,000 Astrophysics Papers
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866917083674050560 |
|---|---|
| author | Ting, Yuan-Sen Accomazzi, Alberto Ghosal, Tirthankar Nguyen, Tuan Dung Pan, Rui Sun, Zechang de Haan, Tijmen |
| author_facet | Ting, Yuan-Sen Accomazzi, Alberto Ghosal, Tirthankar Nguyen, Tuan Dung Pan, Rui Sun, Zechang de Haan, Tijmen |
| contents | We present a dataset of 408,590 astrophysics papers from arXiv (astro-ph), spanning 1992 through July 2025. Each paper has been processed through a multi-stage pipeline to produce: (1) structured summaries organized into six semantic sections (Background, Motivation, Methodology, Results, Interpretation, Implication), and (2) concept extraction yielding 9,999 unique concepts with detailed descriptions. The dataset contains 3.8 million paper-concept associations and includes semantic embeddings for all concepts. Comparison with traditional ADS keywords reveals that the concepts provide denser coverage and more uniform distribution, while analysis of embedding space structure demonstrates that concepts are semantically dispersed within papers-enabling discovery through multiple diverse entry points. Concept vocabulary and embeddings are publicly released at https://github.com/tingyuansen/astro-ph_knowledge_graph. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_12353 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | AstroMLab 5: Structured Summaries and Concept Extraction for 400,000 Astrophysics Papers Ting, Yuan-Sen Accomazzi, Alberto Ghosal, Tirthankar Nguyen, Tuan Dung Pan, Rui Sun, Zechang de Haan, Tijmen Instrumentation and Methods for Astrophysics Physics and Society We present a dataset of 408,590 astrophysics papers from arXiv (astro-ph), spanning 1992 through July 2025. Each paper has been processed through a multi-stage pipeline to produce: (1) structured summaries organized into six semantic sections (Background, Motivation, Methodology, Results, Interpretation, Implication), and (2) concept extraction yielding 9,999 unique concepts with detailed descriptions. The dataset contains 3.8 million paper-concept associations and includes semantic embeddings for all concepts. Comparison with traditional ADS keywords reveals that the concepts provide denser coverage and more uniform distribution, while analysis of embedding space structure demonstrates that concepts are semantically dispersed within papers-enabling discovery through multiple diverse entry points. Concept vocabulary and embeddings are publicly released at https://github.com/tingyuansen/astro-ph_knowledge_graph. |
| title | AstroMLab 5: Structured Summaries and Concept Extraction for 400,000 Astrophysics Papers |
| topic | Instrumentation and Methods for Astrophysics Physics and Society |
| url | https://arxiv.org/abs/2511.12353 |