krisis - v0.2.7

Krisis v0.2.7 Release Notes

Krisis v0.2.7 improves local/open-weight model experimentation and hardens benchmark execution for models that do not reliably return valid JSON.

What’s New

• Added experimental Hugging Face TransformersBackend

  • Run text-generation models locally or in GPU notebooks such as Google Colab.
  • Supports model IDs, device selection, and gated model access through HF_TOKEN.
  • Intended for text-generation models only.

• Improved malformed response handling

  • Hugging Face models that return malformed or non-JSON output no longer have to break the whole benchmark immediately.
  • Krisis can surface a warning-style malformed response result so failures are easier to inspect and debug.

• Better backend documentation

  • Added guidance that the Hugging Face backend only supports text-generation models.
  • Documented HF_TOKEN usage for gated Hugging Face models.
  • Clarified CPU vs GPU expectations for local transformer runs.

• CKDSuite report updates

  • Expanded the CKDSuite benchmark report to include Detection, Staging, and Progression results.
  • Added more discussion around composite safety score interpretation.
  • Refined preliminary reporting language for research-style presentation.

• Version and packaging updates

  • Package version bumped to 0.2.7.
  • Build/test checks were run before release.

Notes

The Hugging Face Transformers backend is experimental in this release. CPU execution can be very slow, so GPU-backed environments are recommended for practical benchmark runs.

Install

pip install krisis==0.2.7

For API-backed models through OpenRouter:

pip install "krisis[api]==0.2.7"

For Hugging Face Transformers:

pip install "krisis[hf]==0.2.7"