Hacc-Man: An Arcade Game for Jailbreaking LLMs

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Valentim, Matheus, Falk, Jeanette, Inie, Nanna
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911886974386176
author Valentim, Matheus
Falk, Jeanette
Inie, Nanna
author_facet Valentim, Matheus
Falk, Jeanette
Inie, Nanna
contents The recent leaps in complexity and fluency of Large Language Models (LLMs) mean that, for the first time in human history, people can interact with computers using natural language alone. This creates monumental possibilities of automation and accessibility of computing, but also raises severe security and safety threats: When everyone can interact with LLMs, everyone can potentially break into the systems running LLMs. All it takes is creative use of language. This paper presents Hacc-Man, a game which challenges its players to "jailbreak" an LLM: subvert the LLM to output something that it is not intended to. Jailbreaking is at the intersection between creative problem solving and LLM security. The purpose of the game is threefold: 1. To heighten awareness of the risks of deploying fragile LLMs in everyday systems, 2. To heighten people's self-efficacy in interacting with LLMs, and 3. To discover the creative problem solving strategies, people deploy in this novel context.
format Preprint
id arxiv_https___arxiv_org_abs_2405_15902
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Hacc-Man: An Arcade Game for Jailbreaking LLMs
Valentim, Matheus
Falk, Jeanette
Inie, Nanna
Cryptography and Security
Artificial Intelligence
Computation and Language
Human-Computer Interaction
The recent leaps in complexity and fluency of Large Language Models (LLMs) mean that, for the first time in human history, people can interact with computers using natural language alone. This creates monumental possibilities of automation and accessibility of computing, but also raises severe security and safety threats: When everyone can interact with LLMs, everyone can potentially break into the systems running LLMs. All it takes is creative use of language. This paper presents Hacc-Man, a game which challenges its players to "jailbreak" an LLM: subvert the LLM to output something that it is not intended to. Jailbreaking is at the intersection between creative problem solving and LLM security. The purpose of the game is threefold: 1. To heighten awareness of the risks of deploying fragile LLMs in everyday systems, 2. To heighten people's self-efficacy in interacting with LLMs, and 3. To discover the creative problem solving strategies, people deploy in this novel context.
title Hacc-Man: An Arcade Game for Jailbreaking LLMs
topic Cryptography and Security
Artificial Intelligence
Computation and Language
Human-Computer Interaction
url https://arxiv.org/abs/2405.15902