Learning Fine-Grained Grounded Citations for Attributed Large Language Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916350607228928 |
|---|---|
| author | Huang, Lei Feng, Xiaocheng Ma, Weitao Gu, Yuxuan Zhong, Weihong Feng, Xiachong Yu, Weijiang Peng, Weihua Tang, Duyu Tu, Dandan Qin, Bing |
| author_facet | Huang, Lei Feng, Xiaocheng Ma, Weitao Gu, Yuxuan Zhong, Weihong Feng, Xiachong Yu, Weijiang Peng, Weihua Tang, Duyu Tu, Dandan Qin, Bing |
| contents | Despite the impressive performance on information-seeking tasks, large language models (LLMs) still struggle with hallucinations. Attributed LLMs, which augment generated text with in-line citations, have shown potential in mitigating hallucinations and improving verifiability. However, current approaches suffer from suboptimal citation quality due to their reliance on in-context learning. Furthermore, the practice of citing only coarse document identifiers makes it challenging for users to perform fine-grained verification. In this work, we introduce FRONT, a training framework designed to teach LLMs to generate Fine-Grained Grounded Citations. By grounding model outputs in fine-grained supporting quotes, these quotes guide the generation of grounded and consistent responses, not only improving citation quality but also facilitating fine-grained verification. Experiments on the ALCE benchmark demonstrate the efficacy of FRONT in generating superior grounded responses and highly supportive citations. With LLaMA-2-7B, the framework significantly outperforms all the baselines, achieving an average of 14.21% improvement in citation quality across all datasets, even surpassing ChatGPT. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_04568 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Learning Fine-Grained Grounded Citations for Attributed Large Language Models Huang, Lei Feng, Xiaocheng Ma, Weitao Gu, Yuxuan Zhong, Weihong Feng, Xiachong Yu, Weijiang Peng, Weihua Tang, Duyu Tu, Dandan Qin, Bing Computation and Language Artificial Intelligence Despite the impressive performance on information-seeking tasks, large language models (LLMs) still struggle with hallucinations. Attributed LLMs, which augment generated text with in-line citations, have shown potential in mitigating hallucinations and improving verifiability. However, current approaches suffer from suboptimal citation quality due to their reliance on in-context learning. Furthermore, the practice of citing only coarse document identifiers makes it challenging for users to perform fine-grained verification. In this work, we introduce FRONT, a training framework designed to teach LLMs to generate Fine-Grained Grounded Citations. By grounding model outputs in fine-grained supporting quotes, these quotes guide the generation of grounded and consistent responses, not only improving citation quality but also facilitating fine-grained verification. Experiments on the ALCE benchmark demonstrate the efficacy of FRONT in generating superior grounded responses and highly supportive citations. With LLaMA-2-7B, the framework significantly outperforms all the baselines, achieving an average of 14.21% improvement in citation quality across all datasets, even surpassing ChatGPT. |
| title | Learning Fine-Grained Grounded Citations for Attributed Large Language Models |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2408.04568 |