Upgrading

Garak undergoes regular breaking changes across CLI flags, plugin naming, and configuration structure; each version bump may require renaming command arguments, relocating config keys, or migrating deprecated components to new systems. When upgrading Garak, check the release notes for renamed probes and generators, changed config namespaces (like model_* to target_*), and CLI flag replacements (such as --run_spec to --spec), which may affect scripts and saved configurations.

The --run_spec CLI flag was renamed to --spec (with short alias -S); the old --run-spec alias was also dropped.[1] The --probes, --probe_tags, and --buffs CLI flags were deprecated in favour of the unified run.spec plugin selection grammar, introduced via --spec (short flag -S) — see Spec grammar and parsing for the grammar reference.[2] In v0.14.0, the --generate_autodan CLI option was removed as a breaking change.[3] The run.spec plugin selection grammar is a structured string format that lets users select and combine probes, generators, and other plugins within a single argument passed to --spec.

In v0.13.1, config keys prefixed model_* were renamed to target_*.[4] Intent configuration keys were moved from the cas namespace to the run namespace — for example, cas.intent_spec becomes run.intent_spec.[5]

The knownbadsignatures probe module was renamed to av_spam_scanning in v0.9.0.16.[6] The atk probe was renamed to atkgen in v0.9.0.10.[7] ART (Attack Red Team) was renamed to AG (Attack Generator) in v0.9.0.8.[8] The generations parameter was moved from generators to probes in v0.9.0.16.[6] In v0.10.0, payload and probe concerns were separated; probes.encoding payloads were migrated to the payloads system.[9] The octo generator was removed in v0.12.0.[10] In v0.14.1, the deprecated nemollm generator and its dependencies were removed as a breaking change.[11]

In v0.13.0, "failure" metric terminology was renamed to "attack success" throughout garak.[12] The maxrecall evaluator was removed in v0.15.0 due to broken Python 3 compatibility.[13] In v0.14.0, HTML reports were fully redesigned as a breaking change.[3]

The default output directory was renamed to garak_runs/ in v0.9.0.12.[14]

Sources

The default output directory was renamed to garak_runs/ in v0.9.0.12.[14]

Sources

Search

Upgrading