Jailbroken models could potentially be used for malicious purposes, such as generating harmful content, spreading misinformation, or engaging in sophisticated phishing attacks.
: Asking the model to simulate a Linux terminal or an unrestricted Python environment, then "running" commands that would normally be blocked in standard conversation. Prompt Injection Gemini Jailbreak Prompt