Skip to content

Releases: mitdralla/mydentify-ai-crawler-access-checker

v1.1.4

Choose a tag to compare

@mitdralla mitdralla released this 12 Aug 21:46

Adds a typed JSR library entry point for the crawler checker and documents the JSR import path. The CLI and checker behavior are unchanged; user-agent probes still originate from the caller and do not prove provider-IP access.

v1.1.3

Choose a tag to compare

@mitdralla mitdralla released this 12 Aug 21:44

Publishes the citation-ready crawler checker as an installable npm CLI. This release adds the npx usage path and aligns the package version with the public release. The checker behavior is unchanged; user-agent probes still originate from the caller and do not prove provider-IP access.

Mydentify AI Crawler Access Checker v1.1.2

Choose a tag to compare

@mitdralla mitdralla released this 12 Aug 21:40

Citation-ready release.

  • Adds standard CITATION.cff software metadata.
  • Adds Zenodo metadata with the canonical hosted checker and public source repository.
  • Keeps the dependency-free CLI and browser-local evaluator behavior unchanged.

The user-agent probes remain ordinary labeled requests and do not originate from verified OpenAI or Anthropic crawler IP ranges.

Mydentify AI Crawler Access Checker v1.1.1

Choose a tag to compare

@mitdralla mitdralla released this 12 Aug 18:36

Prepares the dependency-free CLI for public npm distribution with an explicit public publish configuration and a minimal package file set. Five automated tests pass.

Mydentify AI Crawler Access Checker v1.1.0

Choose a tag to compare

@mitdralla mitdralla released this 12 Aug 18:24

Adds a browser-local robots policy evaluator and GitHub Pages demo.

  • Paste a robots.txt policy and test any path locally in the browser.
  • Compare six documented OpenAI and Anthropic crawler names by purpose.
  • See the matched longest-precedence rule for every crawler.
  • Keep all pasted policy text on-device.
  • Link directly to the full hosted Mydentify crawler-access report for live page and response checks.

CLI behavior and JSON output remain unchanged. Five automated tests pass.

Mydentify AI Crawler Access Checker v1.0.0

Choose a tag to compare

@mitdralla mitdralla released this 12 Aug 18:19

First stable release of the dependency-free Node.js crawler-access checker.

  • Evaluates robots.txt rules for six documented OpenAI and Anthropic crawler names.
  • Separates search, user-requested retrieval, and model-training purposes.
  • Inspects robots meta tags and X-Robots-Tag headers.
  • Sends labeled user-agent probes and states their IP-range limitation.
  • Supports human-readable and JSON output.
  • Includes five passing Node tests and requires no API key or package installation.

Hosted report: https://mydentify.com/tools/ai-crawler-access-checker