Skip to content

v1.5.0

Choose a tag to compare

@Goldziher Goldziher released this 05 Sep 06:56
· 31 commits to main since this release

Changed

  • Upgraded html-to-markdown-rs to 3.12, picking up its Tier-1/Tier-2 GFM autolink parity fix
    and the case-insensitive HTML attribute matching behind the link fix below.

Added

  • Scoop is now a release channel alongside Homebrew: a release publishes a Scoop manifest for the
    CLI, and the install instructions cover it.

Fixed

  • batch-scrape with no URLs reported a different error than every other binding.
    The positional was required = true, so clap aborted at parse time with
    the following required arguments were not provided: <URLS>.... Empty input now
    reaches the library, which returns the same
    invalid_config: batch_urls must not be empty the Python, Node, Go and other
    bindings already return. batch-crawl is unchanged.
  • Links with uppercase or mixed-case attribute names were silently dropped.
    HTML attribute names are case-insensitive, but the parser matched them byte-for-byte
    as written, so <a HREF="/docs/guide.html"> yielded no link at all and
    ReL="nofollow" was not honoured -- the link was lost, not merely mis-resolved. The
    astral-tl 0.8.0 upgrade lowercases attribute keys at parse time. Verified against a
    control build: both cases fail on 0.7.11 and pass on 0.8.0.

Zig

Add to your build.zig.zon:

.dependencies = .{
    .crawlberg-zig = .{\n        .url = \"https://github.com/xberg-io/crawlberg/releases/download/v1.5.0/crawlberg-zig-v1.5.0.tar.gz\",\n        .hash = \"crawlberg-1.5.0-IoY1CmXzPCKfzy4vZnC0_jAPaYU48xzm-t5d5rXHRBc8\",\n    },\n},\n```\n