Exploring the Privacy Protection Capabilities of Chinese Large Language Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yang, Yuqi, Huang, Xiaowen, Sang, Jitao
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913286073614336
author Yang, Yuqi
Huang, Xiaowen
Sang, Jitao
author_facet Yang, Yuqi
Huang, Xiaowen
Sang, Jitao
contents Large language models (LLMs), renowned for their impressive capabilities in various tasks, have significantly advanced artificial intelligence. Yet, these advancements have raised growing concerns about privacy and security implications. To address these issues and explain the risks inherent in these models, we have devised a three-tiered progressive framework tailored for evaluating privacy in language systems. This framework consists of progressively complex and in-depth privacy test tasks at each tier. Our primary objective is to comprehensively evaluate the sensitivity of large language models to private information, examining how effectively they discern, manage, and safeguard sensitive data in diverse scenarios. This systematic evaluation helps us understand the degree to which these models comply with privacy protection guidelines and the effectiveness of their inherent safeguards against privacy breaches. Our observations indicate that existing Chinese large language models universally show privacy protection shortcomings. It seems that at the moment this widespread issue is unavoidable and may pose corresponding privacy risks in applications based on these models.
format Preprint
id arxiv_https___arxiv_org_abs_2403_18205
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Exploring the Privacy Protection Capabilities of Chinese Large Language Models
Yang, Yuqi
Huang, Xiaowen
Sang, Jitao
Artificial Intelligence
Large language models (LLMs), renowned for their impressive capabilities in various tasks, have significantly advanced artificial intelligence. Yet, these advancements have raised growing concerns about privacy and security implications. To address these issues and explain the risks inherent in these models, we have devised a three-tiered progressive framework tailored for evaluating privacy in language systems. This framework consists of progressively complex and in-depth privacy test tasks at each tier. Our primary objective is to comprehensively evaluate the sensitivity of large language models to private information, examining how effectively they discern, manage, and safeguard sensitive data in diverse scenarios. This systematic evaluation helps us understand the degree to which these models comply with privacy protection guidelines and the effectiveness of their inherent safeguards against privacy breaches. Our observations indicate that existing Chinese large language models universally show privacy protection shortcomings. It seems that at the moment this widespread issue is unavoidable and may pose corresponding privacy risks in applications based on these models.
title Exploring the Privacy Protection Capabilities of Chinese Large Language Models
topic Artificial Intelligence
url https://arxiv.org/abs/2403.18205