Repository navigation
SkillEvaluator v0.7.1
SkillEvaluator 0.7.1 packages guided GitHub onboarding, improves CI report feedback, and includes scanner and evaluation runtime fixes.
Highlights
- Set up repository checks with
skillevaluator ci init; useci statusto inspect setup andci demoto open an optional test PR. - Check changed skills with Tier 1 quality checks and SkillSpector security scanning. Optional GitHub feedback includes hosted HTML reports and one updated PR comment.
- Improve scanner setup, local agent installation, Tier 3 progress and results, and provider readiness checks. See the changes below.
Python package
SkillEvaluator 0.7.1 on PyPI · NVIDIA Python package index
Requires Python 3.12, 3.13 or 3.14. Install or upgrade:
pip install --upgrade skillevaluatorBoth the wheel and source distribution are published on PyPI and NVIDIA's index. Package files and SHA-256 checksums are attached below.
CI integration
From your cloned GitHub repository, run:
skillevaluator ci initThe wizard prepares a setup PR for review. Automatic setup requires an existing GitHub CLI login and repository admin access. Checks-only supports public and private repositories; automatic hosted reports and PR comments support public repositories.
For manual GitHub or GitLab setup, download the ready-to-copy CI templates. The bundle includes immutable workflow/image pins, scanner versions and checksums. Open the template folder to copy individual files. The ZIP and checksums are also stored there.
CLI setup guide · GitHub Actions · GitLab CI
What's Changed
- fix(tier2): report a chat-model refusal as an advisory dedup finding by @rng1995 in #281
- fix(security): make the SkillSpector timeout configurable by @rng1995 in #271
- feat(doctor): add Tier 1 scanner and Tier 2 provider readiness checks by @rng1995 in #293
- fix: decode Git roots as file names and keep PowerShell prefix findings (#312 review) by @rng1995 in #320
- feat(tier3): add --skip-with-skill for baseline-only runs by @rng1995 in #284
- fix(security): accept verified referenced images in partial SkillSpector scans by @rng1995 in #299
- test(security): cover SkillSpector watchdog duration boundaries by @rng1995 in #319
- fix(tier3): write plain progress heartbeats once a minute by @rng1995 in #274
- fix(security): handle read-only passwd mounts with SkillSpector 2.13.3 by @rng1995 in #289
- fix(docs): render README images in PyPI descriptions by @chrisknvidia in #323
- Private runtime: prepared packages, native loading and evidence over the existing engine by @chrisknvidia in #264
- Offer to install a missing agent CLI in local mode by @chrisknvidia in #317
- Show per-case Tier 3 results and a "what to fix" list by @chrisknvidia in #316
- chore(release): reconcile published 0.7.0 metadata by @chrisknvidia in #314
- Set up Tier 1 scanners on first use and add --skip by @chrisknvidia in #318
- fix(ci): require Semgrep in scanner subprocesses by @chrisknvidia in #324
- fix(ci): show concise PR feedback with fresh HTML report links by @chrisknvidia in #326
- feat(ci): ship guided GitHub onboarding in SkillEvaluator 0.7.1 by @chrisknvidia in #327
Full Changelog: 0.7.0...v0.7.1