Skip to content

v0.6.8a1

Pre-release
Pre-release

Choose a tag to compare

@fawadss1 fawadss1 released this 12 Jun 09:39
· 30 commits to master since this release

Added

  • Intelligent content wait (_smart_wait)
    The browser engine now detects if a page is a JS challenge, CAPTCHA, or script-heavy stub
    (e.g., Cloudflare, DataDome) and automatically waits for the real content to populate.
    It uses a heuristic based on body length and tag structure to decide whether to wait,
    significantly improving success rates on protected sites while maintaining speed on
    normal pages.
  • JS challenge detection (_JS_IS_CHALLENGE)
    A comprehensive JavaScript-based detector that identifies common anti-bot platforms
    (Cloudflare, DataDome, Akamai, Kasada) and challenge states (Ray ID, "Checking your browser")
    by scanning the DOM and window title.
  • Randomized browser fingerprinting
    Chrome is now launched with randomized --window-size and --lang arguments selected from
    a curated list of common configurations. This ensures that every browser session (and
    every proxy-rotated request) presents a unique, realistic identity to anti-bot systems.

Changed

  • Refactored test cases
    Simplified fetch mocks in tests by removing the unnecessary proxy argument and
    streamlining assertions.

Fixed

  • Browser engine — improved response handling
    Integrated _smart_wait into the fetch pipeline, ensuring 2xx responses are fully
    rendered before returning.