Opening A Pandora's Box: Things You Should Know in the Era of Custom GPTs

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Tao, Guanhong, Cheng, Siyuan, Zhang, Zhuo, Zhu, Junmin, Shen, Guangyu, Zhang, Xiangyu
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911744936378368
author Tao, Guanhong
Cheng, Siyuan
Zhang, Zhuo
Zhu, Junmin
Shen, Guangyu
Zhang, Xiangyu
author_facet Tao, Guanhong
Cheng, Siyuan
Zhang, Zhuo
Zhu, Junmin
Shen, Guangyu
Zhang, Xiangyu
contents The emergence of large language models (LLMs) has significantly accelerated the development of a wide range of applications across various fields. There is a growing trend in the construction of specialized platforms based on LLMs, such as the newly introduced custom GPTs by OpenAI. While custom GPTs provide various functionalities like web browsing and code execution, they also introduce significant security threats. In this paper, we conduct a comprehensive analysis of the security and privacy issues arising from the custom GPT platform. Our systematic examination categorizes potential attack scenarios into three threat models based on the role of the malicious actor, and identifies critical data exchange channels in custom GPTs. Utilizing the STRIDE threat modeling framework, we identify 26 potential attack vectors, with 19 being partially or fully validated in real-world settings. Our findings emphasize the urgent need for robust security and privacy measures in the custom GPT ecosystem, especially in light of the forthcoming launch of the official GPT store by OpenAI.
format Preprint
id arxiv_https___arxiv_org_abs_2401_00905
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Opening A Pandora's Box: Things You Should Know in the Era of Custom GPTs
Tao, Guanhong
Cheng, Siyuan
Zhang, Zhuo
Zhu, Junmin
Shen, Guangyu
Zhang, Xiangyu
Cryptography and Security
The emergence of large language models (LLMs) has significantly accelerated the development of a wide range of applications across various fields. There is a growing trend in the construction of specialized platforms based on LLMs, such as the newly introduced custom GPTs by OpenAI. While custom GPTs provide various functionalities like web browsing and code execution, they also introduce significant security threats. In this paper, we conduct a comprehensive analysis of the security and privacy issues arising from the custom GPT platform. Our systematic examination categorizes potential attack scenarios into three threat models based on the role of the malicious actor, and identifies critical data exchange channels in custom GPTs. Utilizing the STRIDE threat modeling framework, we identify 26 potential attack vectors, with 19 being partially or fully validated in real-world settings. Our findings emphasize the urgent need for robust security and privacy measures in the custom GPT ecosystem, especially in light of the forthcoming launch of the official GPT store by OpenAI.
title Opening A Pandora's Box: Things You Should Know in the Era of Custom GPTs
topic Cryptography and Security
url https://arxiv.org/abs/2401.00905