"Ghost of the past": identifying and resolving privacy leakage from LLM's memory through proactive user interaction
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916445780180992 |
|---|---|
| author | Zhang, Shuning Ye, Lyumanshan Yi, Xin Tang, Jingyu Shui, Bo Xing, Haobin Liu, Pengfei Li, Hewu |
| author_facet | Zhang, Shuning Ye, Lyumanshan Yi, Xin Tang, Jingyu Shui, Bo Xing, Haobin Liu, Pengfei Li, Hewu |
| contents | Memories, encompassing past inputs in context window and retrieval-augmented generation (RAG), frequently surface during human-LLM interactions, yet users are often unaware of their presence and the associated privacy risks. To address this, we propose MemoAnalyzer, a system for identifying, visualizing, and managing private information within memories. A semi-structured interview (N=40) revealed that low privacy awareness was the primary challenge, while proactive privacy control emerged as the most common user need. MemoAnalyzer uses a prompt-based method to infer and identify sensitive information from aggregated past inputs, allowing users to easily modify sensitive content. Background color temperature and transparency are mapped to inference confidence and sensitivity, streamlining privacy adjustments. A 5-day evaluation (N=36) comparing MemoAnalyzer with the default GPT setting and a manual modification baseline showed MemoAnalyzer significantly improved privacy awareness and protection without compromising interaction speed. Our study contributes to privacy-conscious LLM design, offering insights into privacy protection for Human-AI interactions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_14931 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | "Ghost of the past": identifying and resolving privacy leakage from LLM's memory through proactive user interaction Zhang, Shuning Ye, Lyumanshan Yi, Xin Tang, Jingyu Shui, Bo Xing, Haobin Liu, Pengfei Li, Hewu Human-Computer Interaction Memories, encompassing past inputs in context window and retrieval-augmented generation (RAG), frequently surface during human-LLM interactions, yet users are often unaware of their presence and the associated privacy risks. To address this, we propose MemoAnalyzer, a system for identifying, visualizing, and managing private information within memories. A semi-structured interview (N=40) revealed that low privacy awareness was the primary challenge, while proactive privacy control emerged as the most common user need. MemoAnalyzer uses a prompt-based method to infer and identify sensitive information from aggregated past inputs, allowing users to easily modify sensitive content. Background color temperature and transparency are mapped to inference confidence and sensitivity, streamlining privacy adjustments. A 5-day evaluation (N=36) comparing MemoAnalyzer with the default GPT setting and a manual modification baseline showed MemoAnalyzer significantly improved privacy awareness and protection without compromising interaction speed. Our study contributes to privacy-conscious LLM design, offering insights into privacy protection for Human-AI interactions. |
| title | "Ghost of the past": identifying and resolving privacy leakage from LLM's memory through proactive user interaction |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2410.14931 |