Skip to content

SkillEvaluator v0.7.1

Choose a tag to compare

@chrisknvidia chrisknvidia released this 03 Nov 03:59
Immutable release. Only release title and notes can be modified.
3da8c57

SkillEvaluator 0.7.1 packages guided GitHub onboarding, improves CI report feedback, and includes scanner and evaluation runtime fixes.

Highlights

  • Set up repository checks with skillevaluator ci init; use ci status to inspect setup and ci demo to open an optional test PR.
  • Check changed skills with Tier 1 quality checks and SkillSpector security scanning. Optional GitHub feedback includes hosted HTML reports and one updated PR comment.
  • Improve scanner setup, local agent installation, Tier 3 progress and results, and provider readiness checks. See the changes below.

Python package

SkillEvaluator 0.7.1 on PyPI · NVIDIA Python package index

Requires Python 3.12, 3.13 or 3.14. Install or upgrade:

pip install --upgrade skillevaluator

Both the wheel and source distribution are published on PyPI and NVIDIA's index. Package files and SHA-256 checksums are attached below.

CI integration

From your cloned GitHub repository, run:

skillevaluator ci init

The wizard prepares a setup PR for review. Automatic setup requires an existing GitHub CLI login and repository admin access. Checks-only supports public and private repositories; automatic hosted reports and PR comments support public repositories.

For manual GitHub or GitLab setup, download the ready-to-copy CI templates. The bundle includes immutable workflow/image pins, scanner versions and checksums. Open the template folder to copy individual files. The ZIP and checksums are also stored there.

CLI setup guide · GitHub Actions · GitLab CI

What's Changed

  • fix(tier2): report a chat-model refusal as an advisory dedup finding by @rng1995 in #281
  • fix(security): make the SkillSpector timeout configurable by @rng1995 in #271
  • feat(doctor): add Tier 1 scanner and Tier 2 provider readiness checks by @rng1995 in #293
  • fix: decode Git roots as file names and keep PowerShell prefix findings (#312 review) by @rng1995 in #320
  • feat(tier3): add --skip-with-skill for baseline-only runs by @rng1995 in #284
  • fix(security): accept verified referenced images in partial SkillSpector scans by @rng1995 in #299
  • test(security): cover SkillSpector watchdog duration boundaries by @rng1995 in #319
  • fix(tier3): write plain progress heartbeats once a minute by @rng1995 in #274
  • fix(security): handle read-only passwd mounts with SkillSpector 2.13.3 by @rng1995 in #289
  • fix(docs): render README images in PyPI descriptions by @chrisknvidia in #323
  • Private runtime: prepared packages, native loading and evidence over the existing engine by @chrisknvidia in #264
  • Offer to install a missing agent CLI in local mode by @chrisknvidia in #317
  • Show per-case Tier 3 results and a "what to fix" list by @chrisknvidia in #316
  • chore(release): reconcile published 0.7.0 metadata by @chrisknvidia in #314
  • Set up Tier 1 scanners on first use and add --skip by @chrisknvidia in #318
  • fix(ci): require Semgrep in scanner subprocesses by @chrisknvidia in #324
  • fix(ci): show concise PR feedback with fresh HTML report links by @chrisknvidia in #326
  • feat(ci): ship guided GitHub onboarding in SkillEvaluator 0.7.1 by @chrisknvidia in #327

Full Changelog: 0.7.0...v0.7.1