Knowing What LLMs DO NOT Know: A Simple Yet Effective Self-Detection Method
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910376877096960 |
|---|---|
| author | Zhao, Yukun Yan, Lingyong Sun, Weiwei Xing, Guoliang Meng, Chong Wang, Shuaiqiang Cheng, Zhicong Ren, Zhaochun Yin, Dawei |
| author_facet | Zhao, Yukun Yan, Lingyong Sun, Weiwei Xing, Guoliang Meng, Chong Wang, Shuaiqiang Cheng, Zhicong Ren, Zhaochun Yin, Dawei |
| contents | Large Language Models (LLMs) have shown great potential in Natural Language Processing (NLP) tasks. However, recent literature reveals that LLMs generate nonfactual responses intermittently, which impedes the LLMs' reliability for further utilization. In this paper, we propose a novel self-detection method to detect which questions that a LLM does not know that are prone to generate nonfactual results. Specifically, we first diversify the textual expressions for a given question and collect the corresponding answers. Then we examine the divergencies between the generated answers to identify the questions that the model may generate falsehoods. All of the above steps can be accomplished by prompting the LLMs themselves without referring to any other external resources. We conduct comprehensive experiments and demonstrate the effectiveness of our method on recently released LLMs, e.g., Vicuna, ChatGPT, and GPT-4. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_17918 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Knowing What LLMs DO NOT Know: A Simple Yet Effective Self-Detection Method Zhao, Yukun Yan, Lingyong Sun, Weiwei Xing, Guoliang Meng, Chong Wang, Shuaiqiang Cheng, Zhicong Ren, Zhaochun Yin, Dawei Computation and Language Artificial Intelligence Large Language Models (LLMs) have shown great potential in Natural Language Processing (NLP) tasks. However, recent literature reveals that LLMs generate nonfactual responses intermittently, which impedes the LLMs' reliability for further utilization. In this paper, we propose a novel self-detection method to detect which questions that a LLM does not know that are prone to generate nonfactual results. Specifically, we first diversify the textual expressions for a given question and collect the corresponding answers. Then we examine the divergencies between the generated answers to identify the questions that the model may generate falsehoods. All of the above steps can be accomplished by prompting the LLMs themselves without referring to any other external resources. We conduct comprehensive experiments and demonstrate the effectiveness of our method on recently released LLMs, e.g., Vicuna, ChatGPT, and GPT-4. |
| title | Knowing What LLMs DO NOT Know: A Simple Yet Effective Self-Detection Method |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2310.17918 |