You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
scrape_as_markdown and scrape_batch use Bright Data's Fetch API
instead of Web Unlocker. There is no JavaScript rendering.
Both tools return JSON: url, title, format, content, plus final_url after a redirect and a note when relevant. scrape_batch returns an array in input order; a failed URL is {url, error}.
New format param: markdown (default), text, html or ld_json. If the page has no data in that format, markdown is
returned with a note.
scrape_as_markdown stops at 45 s with a timeout error. scrape_batch sends all URLs in one request, cancels at 35 s and
returns the pages that finished; the rest get a timeout error.