Hierarchical Indexing for Retrieval-Augmented Opinion Summarization

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Hosking, Tom, Tang, Hao, Lapata, Mirella
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929423378284544
author Hosking, Tom
Tang, Hao
Lapata, Mirella
author_facet Hosking, Tom
Tang, Hao
Lapata, Mirella
contents We propose a method for unsupervised abstractive opinion summarization, that combines the attributability and scalability of extractive approaches with the coherence and fluency of Large Language Models (LLMs). Our method, HIRO, learns an index structure that maps sentences to a path through a semantically organized discrete hierarchy. At inference time, we populate the index and use it to identify and retrieve clusters of sentences containing popular opinions from input reviews. Then, we use a pretrained LLM to generate a readable summary that is grounded in these extracted evidential clusters. The modularity of our approach allows us to evaluate its efficacy at each stage. We show that HIRO learns an encoding space that is more semantically structured than prior work, and generates summaries that are more representative of the opinions in the input reviews. Human evaluation confirms that HIRO generates significantly more coherent, detailed and accurate summaries.
format Preprint
id arxiv_https___arxiv_org_abs_2403_00435
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Hierarchical Indexing for Retrieval-Augmented Opinion Summarization
Hosking, Tom
Tang, Hao
Lapata, Mirella
Computation and Language
We propose a method for unsupervised abstractive opinion summarization, that combines the attributability and scalability of extractive approaches with the coherence and fluency of Large Language Models (LLMs). Our method, HIRO, learns an index structure that maps sentences to a path through a semantically organized discrete hierarchy. At inference time, we populate the index and use it to identify and retrieve clusters of sentences containing popular opinions from input reviews. Then, we use a pretrained LLM to generate a readable summary that is grounded in these extracted evidential clusters. The modularity of our approach allows us to evaluate its efficacy at each stage. We show that HIRO learns an encoding space that is more semantically structured than prior work, and generates summaries that are more representative of the opinions in the input reviews. Human evaluation confirms that HIRO generates significantly more coherent, detailed and accurate summaries.
title Hierarchical Indexing for Retrieval-Augmented Opinion Summarization
topic Computation and Language
url https://arxiv.org/abs/2403.00435