v0.1.0 #1
svdC1
announced in
Announcements
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Initial release. Synchronous client surface.
Added
ScrapeDoClientsynchronous client withrequest(),get(),post(),execute(), andexecute_from_url()methods.Smart routing in
ScrapeDoClient.request(): accepts kwargs, a pre-builtRequestParameters, or a rawapi.scrape.doURL — exactly one configuration shape per call.Automatic retries on Scrape.do gateway errors (429 / 502 / 510) with configurable backoff strategy (static float or callable). Default is jittered exponential.
session_validatorcallback (SyncSessionValidator) for sticky-session rotation detection — when present andsession_idis set, the validator decides whether to raiseRotatedSessionError.SDK-native event hooks via
SyncClientEventHooksTypedDict:request/response/retrylifecycle, distinct from httpx transport-level hooks.Pydantic-validated
RequestParameterscovering the full Scrape.do API parameter surface, including browser-action models (ClickAction,WaitAction,FillAction,ExecuteAction,ScreenShotAction, scrolling, request-completion waits).ScrapeDoResponsewrapper exposing the parsed JSON envelope, network requests, websocket frames, action results, screenshots, frames, plus a rawstatus_codepassthrough.Cookie isolation between sequential requests on the underlying
httpx.Client(prevents cross-request bleed).Exception hierarchy:
ScrapeDoError(base),APIConnectionError,TargetError,RotatedSessionError, plus the API-layerAuthenticationError,BadRequestError,RateLimitError,ServerError, andAuthenticationThrottleError.Default request timeout raised to 60 seconds (from httpx's 5s default) to accommodate browser rendering and proxy round-trips.
This discussion was created from the release v0.1.0.
Beta Was this translation helpful? Give feedback.
All reactions