Jailbreak
Jailbreak
The act of bypassing the safety restrictions built into an AI or a device.
In Simple Terms
A jailbreak is when you break through the safety restrictions on a phone or an AI and force it to do things that are normally off-limits. For example, you can tell an AI that refuses dangerous questions to play a fictional character, and use that trick to get it to answer with information it's not supposed to share. It's treated as an attack method that slips past safety measures, so researchers keep studying it and building defenses against it.
Behind the Name
The name is built from "jail" (a prison) and "break" (to burst through), which together make the everyday English word for a prison escape. Busting out through a prison's sturdy walls was compared to sneaking past the safety restrictions locked onto a system or an AI, and the name stuck for that kind of unauthorized bypass.
Take a Closer Look!
A jailbreak means breaking through the usage restrictions set on a device, a piece of software, or an AI, so that it can do things it normally isn't allowed to do.
The word originally referred to modifying a device like a smartphone so it could run apps from outside the official store, but these days it also covers breaking the safety restrictions of generative AI.
A jailbreak of a generative AI is an attack that uses cleverly written instructions to get around the safety rules meant to stop the AI from giving out harmful information.
For example, an AI that normally refuses dangerous questions can be made to answer them as lines in an imaginary play, or be handed special conditions that fool it into letting its restrictions slip.
The key feature is that clever wording is what lets the attacker slip past the AI's guardrails.
Attacks like this are taken seriously as a threat to AI safety.
That's why developers strengthen their defenses by setting up filters in two layers so the AI doesn't get fooled, and by doing extra training to prevent misuse.
Jailbreak techniques are also used in tests that check whether the safety measures can be broken.