SkillWatch v0.2.0 — periodic URL content monitoring for AI agent skills and MCP tools.
What it does
Watches the web pages that AI tools rely on and tells you when something changes. Runs 13 pattern checks on changed content to flag suspicious additions.
Install
pip install skillwatchKey numbers
- 236 tests, 95% coverage
- 78.9% precision, 75% recall overall, 50% against evasive attacks
- 13 pattern checks with ROT13, reversed text, and HTML comment decoding
- 5 runtime dependencies, Apache 2.0 licence
What is new in v0.2.0
- 32 prompt injection patterns covering 7 languages
- Pre-detection decoding for ROT13, reversed text, and HTML comments
- Unicode lookalike character detection
- SRI hash false-positive fix (precision 72.2% to 78.9%)
- Status command, add-time URL validation
- GitHub Action for CI/CD integration
- Mypy strict, all actions SHA-pinned, dependabot configured
- Hermetic E2E test with ephemeral HTTP server
- Honest ceiling statement documenting what the tool cannot catch
Full changelog: https://github.com/kuzivaai/SkillWatch/blob/main/CHANGELOG.md