Skip to content

v2.0.30

Choose a tag to compare

View all tags
@github-actions github-actions released this 01 Aug 19:23
· 196 commits to main since this release
v2.0.30
fd33e06
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

2.0.30 (2026-08-01)

Bug Fixes

  • crawler: stop writing a crawl dataset nothing reads (0273f78)

    Every crawled page was pushed to a Crawlee Dataset that no code ever read
    back. Results reach storage through the async generator, not the dataset,
    so the writes only cost disk and I/O - 15MB across 15 directories on one
    install.

    • Replace processBatch with drainResults, which hands over the buffered
      results and clears it
    • Drop the dataset open/drop in initialize and the delete-time cleanup in
      delete_documentation, which no longer has anything to delete
    • Correct the delete_documentation tool description, README and AGENTS.md,
      which all still described a crawl cache that no longer exists

    delete_documentation no longer reports 'crawl cache (Crawlee dataset)'
    among its deleted items.

Assets 2
Loading