jevcrawl 0.2.0

Optional JavaScript rendering: install the js extra (uvx --from "jevcrawl[js]" jevcrawl, then playwright install chromium) and pages that are empty without JavaScript are rendered in headless Chromium, at most five per call. They are listed in stats.js_rendered_urls. Set JEVCRAWL_RENDER_JS=0 to turn it off.

jevcrawl 0.1.1

jevcrawl now follows each site's robots.txt by default. Set JEVCRAWL_RESPECT_ROBOTS=0 to turn it off.

jevcrawl 0.1.0

Full Changelog: https://github.com/RayenMlayeh/jevcrawl/commits/v0.1.0