Loading…
It is an open-source toolkit and benchmark for prompt injection attacks and defenses in large language models (LLMs). It enables the implementation, evaluation, and extension of attacks, defenses, and LLM-integrated applications and agents. It provides setup instructions and examples, including Python/conda environments and integrations with PaLM2, LLaMA, and OpenAI GPT.
AI named Open-Prompt-Injection from February 2026 to March 2026.