Citegeist: Automated Generation of Related Work Analysis on the arXiv Corpus

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Beger, Claas, Henneking, Carl-Leander
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909961325379584
author Beger, Claas
Henneking, Carl-Leander
author_facet Beger, Claas
Henneking, Carl-Leander
contents Large Language Models provide significant new opportunities for the generation of high-quality written works. However, their employment in the research community is inhibited by their tendency to hallucinate invalid sources and lack of direct access to a knowledge base of relevant scientific articles. In this work, we present Citegeist: An application pipeline using dynamic Retrieval Augmented Generation (RAG) on the arXiv Corpus to generate a related work section and other citation-backed outputs. For this purpose, we employ a mixture of embedding-based similarity matching, summarization, and multi-stage filtering. To adapt to the continuous growth of the document base, we also present an optimized way of incorporating new and modified papers. To enable easy utilization in the scientific community, we release both, a website (https://citegeist.org), as well as an implementation harness that works with several different LLM implementations.
format Preprint
id arxiv_https___arxiv_org_abs_2503_23229
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Citegeist: Automated Generation of Related Work Analysis on the arXiv Corpus
Beger, Claas
Henneking, Carl-Leander
Machine Learning
Large Language Models provide significant new opportunities for the generation of high-quality written works. However, their employment in the research community is inhibited by their tendency to hallucinate invalid sources and lack of direct access to a knowledge base of relevant scientific articles. In this work, we present Citegeist: An application pipeline using dynamic Retrieval Augmented Generation (RAG) on the arXiv Corpus to generate a related work section and other citation-backed outputs. For this purpose, we employ a mixture of embedding-based similarity matching, summarization, and multi-stage filtering. To adapt to the continuous growth of the document base, we also present an optimized way of incorporating new and modified papers. To enable easy utilization in the scientific community, we release both, a website (https://citegeist.org), as well as an implementation harness that works with several different LLM implementations.
title Citegeist: Automated Generation of Related Work Analysis on the arXiv Corpus
topic Machine Learning
url https://arxiv.org/abs/2503.23229