$ the-wire ยท showcase
WatsonX SDKs go opt-in, Jev arrives as a typed provider
By RepoJournal ยท Filed ยท About AI Red Teaming ยท Composed from the cited sources ยท methodology
promptfoo's two breaking-adjacent shifts lead the wire: default installs stop pulling IBM's SDKs and TypeSafe's Jev becomes a first-class provider, while PyRIT adds a grid-composite image attack converter and garak stops telling users to file bugs for 404s.
perf(providers)!: make WatsonX SDKs opt-in promptfoo/promptfoo
`@ibm-cloud/watsonx-ai` and `ibm-cloud-sdk-core` are now optional peers rather than default dependencies, so anyone running WatsonX providers must install the supported pair alongside promptfoo or hit actionable installation guidance on first use.
feat(providers): add TypeSafe Jev provider promptfoo/promptfoo
`typesafe:<model>` runs TypeSafe's Jev, which answers typed questions (Noul, Score, Choice) with probabilities instead of generating text, letting you back `llm-rubric` grading, the `classifier` assertion, and the provider under test. Set `TYPESAFE_API_KEY` and point a question config at it.
FEAT: Grid composite converter microsoft/PyRIT
`GridCompositeConverter` renders prompt text into one cell of an image grid padded with innocuous tiles, aimed at image adaptive scenarios that smuggle text into vision-enabled targets. Images, grid size, tile size, payload position, background, font, and a seed are all parameters.
fix(generators): raise clear error on HF InferenceAPI 404 response NVIDIA/garak
`huggingface.InferenceAPI` no longer surfaces a 404 as `TypeError: Unsure how to parse ๐ค API response type: b'Not Found', please open an issue...`; the contributors note it previously told users to file a bug report for an HTTP-level model-not-found response. A missing model now reads as a missing model instead of sending you to the issue tracker.
FIX Credit GOAT research and distinguish PyRIT adaptation microsoft/PyRIT
The GOAT research citations were corrected and the PyRIT adaptation is now marked distinctly so operators can tell upstream findings from this implementation. Smaller items the same cycle: PyRIT notebook helpers for scenario conversations and full reports, faster Docker CI, promptfoo's immutable job-result snapshots, and a supertest 7.3.0 bump.
Action items
- โ Install @ibm-cloud/watsonx-ai and ibm-cloud-sdk-core alongside promptfoo if you run any WatsonX provider promptfoo/promptfoo [plan]
