Repository navigation
skillspector-rs: an optimized Rust port of the static analysis (no LLM yet) #920
Dansemums
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Hi SkillSpector team and community,
I built skillspector-rs (https://github.com/Dansemums/skillspector-rs), an independent, unofficial Rust port of SkillSpector's deterministic
--no-llmanalysis. It is not affiliated with or endorsed by NVIDIA; the rules, rule ids and heuristics are derived from SkillSpector v2.12.0 (commit d7338f5) under Apache-2.0, with NVIDIA credited in NOTICE.What it is
What is not there yet (see the README roadmap)
The LLM semantic analyzers and the meta analyzer, provider adapters, OSV lookups (SC4), transitive references, MCP registry mode, baselines, and the time budgets/ledger. A few pattern analyzers are also still missing (P5, TP1-TP3, TR2); they are listed in
tests/fixtures/KNOWN_DIFFERENCES.md.Parity
I compare
(file, rule id, start line)per skill folder against SkillSpector's own--no-llmoutput. On a private corpus of 865 real skill folders: 2777 of 2800 findings match with 0 extra findings and 0 errors; the 23 differences are SC4 (needs the network) and a few runtime-limit coverage notes that depend on machine load. On the public fixtures in the repo: 86 of 93 reference findings match (4 extra, all from the not-yet-ported analyzers above).skillspector-rs-diffand the golden-generation scripts are in the repo so anyone can check this on their own skills.Speed (Apple M1 Pro, 8 cores, one process per scan, cold start included; full table with p95/p99 and memory in
docs/SCOREBOARD.md):I would love feedback on parity gaps (the
skillspector-rs-diffoutput makes them easy to report), and I am glad to adjust anything about naming or attribution if you prefer something different.All reactions