garak is a CLI-first LLM vulnerability scanner that probes for hallucination, data leakage, prompt injection, misinformation, toxicity generation, jailbreaks, and many other weaknesses using static, dynamic, and adaptive probes.[1] Developed primarily for Linux and OSX, garak is a command-line tool.[1] As of v0.15.0, the project's documentation was restructured from a flat directory into a tree hierarchy.[2] A probe in garak is an automated test that sends crafted inputs to an LLM and evaluates its responses for a specific class of vulnerability.
Sources