Enhancing Retrieval Augmented Generation with Hierarchical Text Segmentation Chunking

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Nguyen, Hai Toan, Nguyen, Tien Dat, Nguyen, Viet Ha
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918091048353792
author Nguyen, Hai Toan
Nguyen, Tien Dat
Nguyen, Viet Ha
author_facet Nguyen, Hai Toan
Nguyen, Tien Dat
Nguyen, Viet Ha
contents Retrieval-Augmented Generation (RAG) systems commonly use chunking strategies for retrieval, which enhance large language models (LLMs) by enabling them to access external knowledge, ensuring that the retrieved information is up-to-date and domain-specific. However, traditional methods often fail to create chunks that capture sufficient semantic meaning, as they do not account for the underlying textual structure. This paper proposes a novel framework that enhances RAG by integrating hierarchical text segmentation and clustering to generate more meaningful and semantically coherent chunks. During inference, the framework retrieves information by leveraging both segment-level and cluster-level vector representations, thereby increasing the likelihood of retrieving more precise and contextually relevant information. Evaluations on the NarrativeQA, QuALITY, and QASPER datasets indicate that the proposed method achieved improved results compared to traditional chunking techniques.
format Preprint
id arxiv_https___arxiv_org_abs_2507_09935
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Enhancing Retrieval Augmented Generation with Hierarchical Text Segmentation Chunking
Nguyen, Hai Toan
Nguyen, Tien Dat
Nguyen, Viet Ha
Computation and Language
Artificial Intelligence
Retrieval-Augmented Generation (RAG) systems commonly use chunking strategies for retrieval, which enhance large language models (LLMs) by enabling them to access external knowledge, ensuring that the retrieved information is up-to-date and domain-specific. However, traditional methods often fail to create chunks that capture sufficient semantic meaning, as they do not account for the underlying textual structure. This paper proposes a novel framework that enhances RAG by integrating hierarchical text segmentation and clustering to generate more meaningful and semantically coherent chunks. During inference, the framework retrieves information by leveraging both segment-level and cluster-level vector representations, thereby increasing the likelihood of retrieving more precise and contextually relevant information. Evaluations on the NarrativeQA, QuALITY, and QASPER datasets indicate that the proposed method achieved improved results compared to traditional chunking techniques.
title Enhancing Retrieval Augmented Generation with Hierarchical Text Segmentation Chunking
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2507.09935