Mydentify AI Crawler Access Checker v1.1.0

mitdralla released this 12 Aug 18:24

· 5 commits to main since this release

1f37ee7

Adds a browser-local robots policy evaluator and GitHub Pages demo.

Paste a robots.txt policy and test any path locally in the browser.
Compare six documented OpenAI and Anthropic crawler names by purpose.
See the matched longest-precedence rule for every crawler.
Keep all pasted policy text on-device.
Link directly to the full hosted Mydentify crawler-access report for live page and response checks.

CLI behavior and JSON output remain unchanged. Five automated tests pass.

Assets 2