-
Notifications
You must be signed in to change notification settings - Fork 230
datadome explained
DataDome is not a library you install and read the source of. It is a paid service run partly on its own servers, so most of what circulates about it online is reverse-engineered from the outside rather than read from a repository. That is a real gap in a corpus like this one: DataDome sits in front of a large share of retail, travel and ticketing traffic, and "datadome bypass" and "datadome cookie playwright" are two of the most consistently searched anti-bot terms there are.
This page separates what DataDome documents about its own product from what independent reverse engineering has confirmed, and says which is which. The short version: a request is scored on three layers before the page finishes loading, the TLS/HTTP handshake, a JavaScript collector that checks the device and, over the session, your behavior, and a cookie that remembers the verdict so the first two do not run again. None of the three are secret in outline. The scoring model behind them is.
Read from DataDome's own documentation on 2026-08-30
(docs.datadome.co, the
Device Check, JavaScript Tag, cookie and pre-activation checklist pages) and
from practitioner reverse engineering also read 2026-08-30 (Scrapfly,
ZenRows, and a public GitHub tool built to talk to DataDome's own challenge).
Anything sourced only to the second group is marked as such below.
| Layer | What it checks | Runs where |
|---|---|---|
| Network | TLS handshake (JA3/JA4-class fingerprint), HTTP/2 frame order, IP and ASN reputation | On the wire, before any page content is served |
| Device and behavior | Canvas, WebGL, audio and font signals, automation-framework tells, then mouse, scroll, click and typing patterns over the session | An in-page JavaScript tag |
| Session memory | An encrypted datadome cookie holding the last verdict |
Your cookie jar, read on every subsequent request |
A request that fails the network layer badly enough never needs the other two. A request that looks fine on the network but has no cookie, or an expired one, gets the JavaScript layer. A request with a valid cookie mostly skips straight through: DataDome says plainly that once a device or visitor has been verified, "DataDome remembers the outcome and does not repeat the verification."
The TLS ClientHello, sent before either side has exchanged a single
application byte, encodes which cipher suites, TLS version and extensions
the client supports, and it differs by TLS library in ways JavaScript cannot
touch, because JavaScript has not started running yet. DataDome's own
engineering blog (read via its Security Boulevard reprint, since the
original page on datadome.co blocked direct retrieval this session) states
the fingerprint is "quite stable and unique for a device type, browser, and
OS," and that the same model catches two patterns: bots whose TLS stack has
a fingerprint nothing else shares, and clients claiming to be one thing
(Chrome 102, say) while their handshake belongs to something else. How JA3
and JA4 actually work, and why neither can be patched from inside the
browser; the HTTP/2 SETTINGS frame and header
order sit one layer above it, and DataDome reads that too.
Same source: DataDome states its engine processes on the order of three trillion signals a day (2022 figure). A separate 2026 write-up from Scrapfly, a scraping infrastructure vendor, cites five trillion a day and "over 85,000 customer-specific and use-case-specific models," one set per protected site rather than one global model. Four years apart and not necessarily in tension, but neither figure is audited, so treat both as vendor reporting rather than something this page verified independently.
IP and ASN sit in the same layer conceptually: whether the address is residential, mobile or datacenter, its distance from the claimed timezone, how many recent requests share it. What ASN and IP reputation actually score, and how fast it decays, is covered separately; DataDome's docs do not detail IP scoring, so this leans on the practitioner writeups rather than DataDome's own pages.
DataDome's own JavaScript Tag documentation describes an inline script meant
to sit at the very start of <head>, before any other resource loads, so it
can intercept XMLHttpRequest and fetch calls and show a challenge before
the page's own requests go out:
<script>
window.ddjskey = 'YOUR_DATADOME_JS_KEY';
window.ddoptions = {};
</script>
<script src="https://js.datadome.co/tags.js" async></script>ddjskey is the site's own public key, set by whoever integrates DataDome,
not something generated per visitor. According to DataDome's own docs, the
tag collects two kinds of data: "behavioral data from the client... such as
mouse movements or key strokes," and "generic information about the OS, the
browser itself, the GPU, etc." It also runs, in DataDome's own words,
consistency checks aimed specifically at Headless Chrome, Puppeteer,
Puppeteer Extra Stealth and modified Selenium builds. The payload is POSTed
to api-js.datadome.co/js/.
DataDome does not publish the individual checks inside that collector, so
the specifics here come from reverse engineering, not docs.datadome.co.
ZenRows' own deobfuscation of a live DataDome bundle reports "over 35
functions" prefixed dd_, gathering canvas, WebGL and font signals alongside
the automation-framework checks DataDome's docs already name. Scrapfly's
breakdown, published as part of its own bypass product, adds more: dual-
probing 19 MIME types twice, checking WebGL parameter coherence, reading
navigator.keyboard.getLayoutMap(), battery status, speechSynthesis voice
lists, camera/microphone permission state, and two separate sets of
User-Agent Client Hints. A vendor selling a bypass product has an obvious
incentive to make its own reverse engineering sound thorough, so read this
list as corroborated in outline, two unrelated writeups converge on canvas,
WebGL, fonts and automation-framework checks, rather than verified line by
line.
DataDome's own Device Check feature is the name for the invisible version of this: it fires, per DataDome's docs, "when a bot is detected... but the evidence of bot activity is not strong enough to block it," or when the requested resource looks sensitive on its own. It is enabled by default, "collect[s] hundreds of signals and perform[s] several checkpoints on the device and environment," and returns one of three outcomes: block, allow, or escalate to a visible challenge. DataDome states plainly that "no personal information is collected" by this step.
DataDome's own cookie documentation is specific: named datadome,
documented at roughly 128 bytes, expiring after about a year, its value
encrypted and, per DataDome, holding no personally identifying information.
The same page instructs site owners never to mark it HttpOnly or move its
Domain/Path, because DataDome's own JavaScript needs to read and write it
directly, the opposite of how a typical session-security cookie is usually
configured. DataDome describes the cookie's job as enabling "both
server-side and client-side detection to assess the legitimacy of a
request." Reading and setting cookies through a Playwright context, and why
a hand-set cookie can look unearned next to one a real visit produced, has
its own page.
For what happens when that cookie is missing, expired, or fails validation, DataDome's pre-activation docs name two default challenge types per protected endpoint: Slider, the primary one, and Device Check as the automatic fallback if Slider is turned off for that endpoint. If an operator disables both for an endpoint, requests there are simply allowed through, per DataDome's own docs, a genuine gap and not a weakness anyone has to guess at.
The page a browser sees when neither a valid cookie nor a passing Device
Check is present is what people who reverse-engineer DataDome call the
"interstitial" or the "5-second challenge", terms from that community, not
DataDome's own published vocabulary in what this page could retrieve. A
concrete example of that reverse engineering: a public GitHub project,
Datadome-Interstital-Encryptor, builds exactly the encrypted payload this
challenge expects. Its README shows the inputs, a datadome cookie, a
per-site hash, and named "signals" added one at a time before the tool
encrypts them into a payload submitted back in exchange for a fresh
datadome cookie that lets the next request through. The tool proves the
shape of the exchange is real; it does not reveal what DataDome's server
does with the signals, because that part is not public from either side.
A passing Device Check or a valid cookie is not a permanent pass. Per Scrapfly's description, DataDome keeps scoring mouse trajectories, scroll velocity, click coordinates, typing cadence and dwell time across the whole session, comparing that behavioral signature against models trained on that specific site's own legitimate traffic, which is what the per-customer-model figure above describes. What mouse-dynamics behavioral biometrics actually score, distribution by distribution rather than field by field, is covered separately. This is also where an automation script creates its own signal, independent of the engine it drives: a click that always lands dead-center, a scroll that jumps to the same offset on a fixed interval, or fields filled at an inhumanly constant rhythm all read as machine regularity, no matter how faithfully the engine underneath renders canvas or answers TLS.
This is the honest boundary, and it matters more here than almost anywhere else in this corpus, because DataDome checks span from the TLS library up through months of session history.
What a genuinely real Firefox engine answers correctly, by construction,
with nothing spoofed at the JavaScript layer: the TLS handshake and the
HTTP/2 frame order, because they come from a real Firefox stack rather than
an impersonation of one; canvas, WebGL and AudioContext output, because they
come out of the real rendering and audio paths instead of a patched return
value; native function toString() output, navigator.webdriver and the
rest of the automation-framework tells DataDome's own docs name, because
there is no CDP-driven Chromium underneath pretending; and font enumeration
and OS-backed values like navigator.keyboard.getLayoutMap(), because they
come from a real OS-facing path instead of a JavaScript-level override. That
is a claim about which category of check has nothing to find, not a claim
that any specific vendor's model is defeated.
What sits entirely outside what any browser engine, real or patched, can
answer: IP reputation and ASN, a property of the network path rather than
the browser; DataDome's server-side ML score and its per-site models, which
run on DataDome's own infrastructure and are not observable from the client
at all; and account or session history, since the datadome cookie's own
roughly year-long lifetime exists specifically to reward continuity a single
fresh session cannot have. Behavioral scoring sits in a third category: it
is produced by whatever is driving the browser, not the browser itself, a
property of the automation code and its pacing, which has its own, separate
discussion, not of engine realness.
And the interactive Slider challenge specifically is a puzzle a visitor
solves, not a fingerprint a browser answers. invisible_playwright is
engine-level work: a patched Firefox that answers the device and consistency
checks in the table above the way a real Firefox would. It does not include,
and does not sell, a captcha or puzzle-solving service, and nothing here
should be read as a claim that it clears DataDome's slider, its behavioral
scoring, or its server-side risk model. Those are different problems from
the one an honest engine solves, and no amount of engine fidelity
substitutes for a clean, reputable IP or human-paced interaction.
One 2026 wrinkle worth noting: DataDome's own pre-activation checklist now lists MCP (Model Context Protocol) alongside Web Browsers, Mobile Apps and APIs as a "Traffic Source," with a separate "Agentic Trust" setting for scoring AI-agent traffic. It is the same three-layer model applied to a newer client, not a new mechanism: an LLM-driven agent still opens a TLS connection, still runs (or fails to run) the collector, and still produces a behavioral trace, which has a signature of its own that no fingerprint fixes.
What is DataDome? A commercial anti-bot and WAF-adjacent service that protects a site's traffic by scoring the TLS/HTTP handshake, an in-page JavaScript device and behavior collector, and a session cookie, then blocking, challenging or allowing each request.
What triggers DataDome's challenge? A missing or invalid datadome
cookie, a network-layer signal that looks wrong (an inconsistent TLS
fingerprint, a flagged IP), or a JavaScript-layer signal that looks wrong
(an automation-framework tell, an inconsistent device fingerprint). Any one
of the three can be enough on its own.
What is the difference between Device Check and the Slider challenge? Per DataDome's own docs, Slider is the default, primary interactive challenge; Device Check is the automatic, invisible fallback if Slider is turned off for that endpoint, and can also run on its own when evidence against a request is present but not strong enough to block outright.
Does a real, unpatched browser engine beat DataDome? It correctly answers the device and consistency layer, the one an engine can honestly answer. It says nothing about IP reputation, DataDome's server-side ML score, session history, or the Slider puzzle itself, which are separate problems.
Does invisible_playwright solve DataDome's captcha for me? No. It is engine-level realness, a patched Firefox that answers device checks honestly. It does not include a puzzle-solving or captcha-solving service of any kind.
Why would a request still get challenged with a clean fingerprint? Because the fingerprint is one of three layers. A datacenter IP, a session with no history, or a behavioral pattern that reads as machine-regular can each trigger a challenge on their own, independent of whether the device fingerprint was clean.
See also: JA3 and JA4: why a TLS fingerprint cannot be patched, what ASN and IP reputation score, and how fast it decays, what mouse-dynamics behavioral biometrics actually measure, and the checklist for when one site detects you.
- DataDome's own documentation, read 2026-08-30: Device Check, JavaScript Tag, cookie and stored data, and the pre-activation checklist, for trigger conditions, JS Tag behavior, cookie name/size/expiry, and the Slider/Device Check pairing including the MCP/Agentic Trust category.
- DataDome's own engineering blog on TLS fingerprinting, read via its
Security Boulevard reprint
(the original
datadome.copage returned a 403 to this session's fetch tool), read 2026-08-30, for the "three trillion signals a day" figure and the two TLS-mismatch patterns it detects. - Press coverage of the Device Check launch, Help Net Security, 2023-12-12, read 2026-08-30, for the company's self-reported accuracy and SDK-deployment figures at launch.
- Scrapfly, read 2026-08-30: its DataDome bypass product page for the detection-layer chain and collector checks (codec dual-probe, keyboard layout map, WebGL coherence), and its blog post on bypassing DataDome for the 85,000-model and five-trillion-signal figures, both self-reported by a vendor selling a competing bypass product.
- ZenRows' DataDome bypass writeup,
read 2026-08-30, for its own deobfuscation results (the
dd_-prefixed function count) and its TLS/header check description. -
glizzykingdreko/Datadome-Interstital-Encryptoron GitHub, read 2026-08-30, a real public reverse-engineering project, for the concrete shape of the interstitial payload (cookie, site hash, named signals) practitioners have independently worked out.
From the notes of invisible_playwright. DataDome does not publish its scoring model or the full list of what its collector checks, so this page draws a line between DataDome's own documentation and outside reverse engineering everywhere that line exists, rather than presenting both as equally certain.
Documentation
Guides
-
Browser Identity
- navigator.webdriver is not the tell you think it is
- hardwareConcurrency, deviceMemory and storage quota
- Screen size and viewport tells in headless browsers
- Playwright headless vs headed: what detectors see
- Playwright User Agent: Why You Should Not Set It
- Client Hints and Sec-Fetch: headers that must agree
- Codec fingerprinting: canPlayType and MediaCapabilities
- Permissions API: the two answers that must agree
- CSS fingerprinting: what media queries reveal
- What privacy.resistFingerprinting actually does
- speechSynthesis.getVoices() returns an empty array
- Browser extensions are a fingerprint surface
- BFCache and pageshow.persisted under browser automation
- Service workers, storage partitioning and automation
- Web Workers: where page-level fingerprint patches fail
- fake-useragent is archived: what changes and what doesn't
- navigator.buildID and the stale build date tell
- navigator.maxTouchPoints and pointer consistency
- navigator.platform and oscpu on a spoofed OS
- navigator.vendor and productSub: the Firefox tells
- Accept-Language header vs navigator.languages
- window.devicePixelRatio: the pref that spoofs it
- Can you be fingerprinted in incognito mode?
- Is changing the user agent enough to avoid detection?
- Can a website tell you are running on a server?
- Can two devices share a browser fingerprint?
- Does clearing cookies stop fingerprint tracking?
- Color-gamut and HDR media queries as a fingerprint
- Battery API fingerprint: does Firefox expose it?
- Is navigator.connection a fingerprint in Firefox?
- Can the Gamepad API fingerprint or detect a bot?
- Do accelerometer and gyroscope APIs leak on desktop?
- prefers-reduced-motion and other OS-setting tells
- Does storage quota estimate reveal disk size?
- Can scrollbar width reveal my operating system?
-
Canvas, WebGL, Fonts and Audio
- Canvas fingerprint noise: why per-call randomising fails
- Firefox WebGL renderer strings: what ANGLE reports
- WebGL parameters: the numbers are the same on every GPU
- Your renderer string says NVIDIA. Your pixels say software.
- Why headless browsers render different fonts
- How to make Linux and macOS report real Windows fonts
- measureText and TextMetrics as a fingerprinting surface
- AudioContext fingerprinting, and why adding noise backfired
- Canvas and WebGL fingerprints, identical across OSes
- Emoji fingerprinting: why emoji look the same on any OS
- Detecting installed fonts in JavaScript by width
- WebGL shader precision as a fingerprint surface
- AudioContext sampleRate and latency as a fingerprint
- Is WebGPU a browser fingerprint?
-
Network, Proxy and WebRTC
- WebRTC leak with a proxy in Playwright and Selenium
- WebRTC ICE candidate spoofing: the fields that give it away
- Playwright proxy in Python: per-context, and what leaks
- Playwright proxy not working? SOCKS5 auth in Python
- Playwright timezone does not match the proxy IP
- JA3 and JA4: why a TLS fingerprint cannot be patched
- Playwright in Docker: it runs, and still gets blocked
- Web scraping keeps getting blocked with good proxies
- Python web scraping blocked? The TLS fingerprint reason
- SOCKS5 vs HTTP proxy: what each does in the browser
- WebRTC IPv6 leak: why a proxy does not stop it
- HTTP/2 fingerprint: the layer above the TLS handshake
- TLS fingerprint vs User-Agent: the contradiction
- WebRTC has no ICE candidates behind a proxy
- WebRTC IP that matches the proxy exit, by design
- How to check if a proxy leaks your real IP
- about:webrtc: read your real ICE candidates
- Offline timezone resolution from a proxy exit IP
- Residential vs datacenter vs mobile proxies explained
- Sticky vs rotating proxy sessions: which to use
- Does a proxy leak DNS? DoH and DNS leaks explained
- HTTP/3 and QUIC fingerprint: what a site sees
- What is ASN and IP reputation in bot detection?
- What does a mobile carrier IP look like to a site?
- IPv6 vs IPv4: which does your proxy expose?
- Geolocation API vs IP location: keep them consistent
- Does chaining two proxies help avoid detection?
- ERR_HTTP2_PROTOCOL_ERROR in Playwright: causes and how to diagnose it
- ERR_TUNNEL_CONNECTION_FAILED in Playwright: what it means and how to fix it
- ERR_SOCKS_CONNECTION_FAILED in Playwright: what it means and how to fix it
- net::ERR_CONNECTION_RESET in Playwright
- net::ERR_PROXY_CONNECTION_FAILED in Playwright
- net::ERR_ABORTED in Playwright
- net::ERR_NAME_NOT_RESOLVED in Playwright
- net::ERR_CERT_AUTHORITY_INVALID in Playwright
- net::ERR_EMPTY_RESPONSE in Playwright
- net::ERR_CONNECTION_REFUSED in Playwright
- net::ERR_INVALID_AUTH_CREDENTIALS in Playwright
- JA4H: The HTTP-Header-Order Fingerprint, Explained
-
The Automation Layer
- Function.prototype.toString and the [native code] check
- The ChromeDriver
cdc_variable, and why renaming it fails - Why an attached debugger makes automation detectable
- Execution context was destroyed, and when it means detection
- Human-like mouse movement: Bezier curves are the easy part
- Why a Playwright upgrade broke 97 of 133 tests overnight
- Playwright persistent profile: what it fixes and breaks
- Why humanized mouse movement can fail on hover()
- Why content_frame() returns None for a cross-origin iframe
- Orphaned Firefox processes on Windows: the killed-runner leak
- Firefox launches but Playwright can't drive it: packaging gap
- Why automating login is riskier than reusing a session
- Playwright new_page vs new_context: the viewport tell
- Playwright dialog and popup handling without a tell
- Playwright download files with Firefox and the tell
- Playwright connect_over_cdp does not work with Firefox
- Playwright mobile emulation on Firefox and isMobile
- Playwright isTrusted: are automated clicks real?
- Playwright set_input_files uploads and the tell
- Can websites detect Playwright? What is actually visible
- Does Playwright Set navigator.webdriver to True?
- Does Playwright Leave Traces a Website Can See?
- Does Playwright Change My Browser Fingerprint?
- Can I Use My Real Browser Profile With Playwright?
- Does Playwright Support Firefox Stealth?
- Is Playwright Firefox Harder to Detect Than Chromium?
- Does Playwright Get Detected on the First Request?
- Why Playwright's bundled Firefox is easy to detect
- ghost-cursor human mouse paths with Playwright
- Stock Playwright, patched Firefox: how they connect
- Intercept and mock network requests with page.route
- Record and replay HTTP traffic with HAR in Playwright
- Record a Playwright trace to debug a failed scrape
- Record a video of a Playwright browser session
- Save and reuse login with storage_state in Playwright
- Read and set cookies in a Playwright context
- Set geolocation and permissions per Playwright context
- Handle HTTP basic auth in Playwright (http_credentials)
- Isolate identities with a browser context per session
- Drag and drop elements in Playwright with drag_to
- When to use an HTTP client vs a real browser
- Migrating from requests + BeautifulSoup to a browser
- Playwright 1.61's WebAuthn Virtual Authenticator
- Playwright 1.62: Headless No Longer Shares the OS Clipboard
-
AI Agents and Frameworks
- AI browser agents and stealth: what fits and what does not
- browser-use gets detected: what you can and cannot change
- crawl4ai stealth mode and custom browser engines
- Give a LangChain agent an invisible_playwright browser
- Feed invisible_playwright pages into a RAG index
- Computer-use agents and browser fingerprint detection
- Give an MCP browser server a stealth Firefox engine
- Give each AI agent a reproducible browser identity
- Run parallel browser agents with distinct fingerprints
- Why AI browser agents have their own timing signal
- Running an AI browser agent headless on a server
- Give a browser agent a persistent logged-in session
- smolagents: hand the agent an invisible_playwright tool
- Stagehand and stealth: why a Firefox engine won't drop in
- DOM-reading vs screenshot agents: which stealth helps
- Back a computer-use agent with a real browser engine
- AI agent retry loops trip rate limits, not fingerprints
- Playwright 1.62 Ships MCP In the Box
-
Detectors, Explained
- What bot.sannysoft.com actually checks, row by row
- How CreepJS decides you are lying
- What BotD actually detects, and what it does not
- Why a FingerprintJS visitor ID changes
- reCAPTCHA v3 score: why a fresh browser scores badly
- BrowserLeaks canvas and WebGL hash, explained
- What BrowserLeaks actually tests, surface by surface
- Browser trust scores explained: what the number means
- How do websites detect bots?
- What is a browser fingerprint?
- What data does a website collect about your browser?
- Does a VPN stop browser fingerprinting?
- Do websites know you are using a script?
- How accurate is browser fingerprinting?
- Can a website detect a virtual machine?
- Can websites detect a datacenter or proxy IP?
- getClientRects fingerprinting: subpixel geometry as ID
- Notification.permission as a bot-detection signal
- speechSynthesis voices as a cross-platform fingerprint
- Can a website detect typing by keystroke timing?
- Can a website detect Clipboard API access?
- What are mouse-dynamics behavioural biometrics?
- How Cloudflare Turnstile actually works
- How DataDome's bot detection actually works
- How Kasada's bot detection actually works
- PerimeterX (now HUMAN Bot Defender): what the sensor actually checks
- How Akamai Bot Manager actually works
- Imperva (Incapsula), Explained
- F5 Distributed Cloud Bot Defense (Shape), Explained
- Fastly Bot Management, Explained
- reCAPTCHA Enterprise vs reCAPTCHA v3
- Arkose Labs (FunCaptcha), Explained
- AWS WAF Bot Control, Explained
- Anubis: The Proof-of-Work Firewall, Explained
- Cloudflare's AI Labyrinth, Explained
- Beyond robots.txt: How Sites Actually Block AI Crawlers Now
- Vercel Bot Protection (BotID), Explained
- GeeTest v4 (Slide/Click Captcha), Explained
- Honeypot Fields and Hidden Links: How Sites Trap Scrapers
- Private Access Tokens (Privacy Pass), Explained
- hCaptcha, Explained
- hCaptcha Enterprise vs Standard
- Cloudflare Bot Management, Explained
-
Testing and Troubleshooting
- How to test bot detection without a false pass
- Playwright detected as a bot: the checklist to fix it
- Firefox preferences that silently do nothing
- Slow browser launch: a per-request timeout is not a budget
- Playwright screenshot returns noise: readback fix
- Canvas fingerprint changes every run: use a seed
- Playwright TargetClosedError: the causes and the fixes
- Why am I blocked with a clean fingerprint?
- Why Does My Playwright Script Get Blocked?
- Is Playwright headless detectable? What sites check
- Can You Run Playwright Without Being Detected?
- Why Playwright Works Locally but Fails in the Cloud
- Does Playwright Trigger reCAPTCHA More Often?
- net::ERR_SSL_PROTOCOL_ERROR in Playwright
- net::ERR_CONNECTION_TIMED_OUT in Playwright
- net::ERR_NETWORK_CHANGED in Playwright
- TimeoutError: Timeout 30000ms Exceeded
- 'Playwright "Frame Was Detached" Error'
- Playwright "Protocol Error (Page.navigate)"
- Playwright Strict Mode Violation: Resolved to N Elements
- Playwright "Element Is Not Attached to the DOM"
- Playwright "Subtree Intercepts Pointer Events"
- Content-Security-Policy Blocks Playwright's Injected Scripts
- Playwright "Executable Doesn't Exist" After Install
- 'Playwright "Page Crashed" Error'
- Does Playwright Trigger hCaptcha More Often?
- Playwright Firefox: SEC_ERROR_UNKNOWN_ISSUER
- Playwright ERR_BLOCKED_BY_CLIENT via page.route
-
Scraping with Playwright
- How to scrape without getting blocked
- How to scrape a site that blocks headless browsers
- How to scrape infinite scroll pages with Playwright
- How to rotate proxies when scraping with Playwright
- How to scrape data behind a login with Playwright
- How to run Playwright in Docker without getting detected
- How to use invisible_playwright in Docker
- Playwright bot detection: how to avoid it in Python
- How to scrape paginated pages with Playwright
- How to download files with Playwright
- How to upload files with Playwright, and verify it landed
- How to handle cookie consent banners in Playwright
- How to handle popups and modals in Playwright
- How to take full-page screenshots with Playwright
- How to generate a PDF with Playwright and Firefox
- How to wait for content to load in Playwright
- How to retry failed requests when scraping Playwright
- How to scrape pages in parallel with Playwright
- How to rate limit your own Playwright scraper
- How to scrape HTML tables with Playwright
- How to scrape iframe content with Playwright
- How to scrape shadow DOM content with Playwright
- How to capture XHR and API responses in Playwright
- How to scrape geotargeted content with Playwright
- How to scrape real estate listings with Playwright
- How to scrape job postings with Playwright
- How to scrape e-commerce product pages with Playwright
- How to track product prices with Playwright
- How to scrape hotel room prices with Playwright
- How to scrape flight prices with Playwright
- How to scrape classifieds listings with Playwright
- How to scrape vacation rental listings with Playwright
- How to scrape car listings with Playwright
- How to scrape apartment rentals with Playwright
- How to track product stock and restocks with Playwright
- How to scrape location-based store prices with Playwright
- How to scrape flexible-date fare calendars with Playwright
- How to scrape product reviews with Playwright
- How to scrape reviews and ratings with Playwright
- How to scrape news article text with Playwright
- How to scrape business directory listings with Playwright
- How to scrape event and ticket listings with Playwright
- How to scrape restaurant menu data with Playwright
- How to scrape stock and financial data with Playwright
- How to scrape social media profiles with Playwright
- How to scrape forum and community threads with Playwright
- How to scrape image galleries with Playwright
- How to scrape video listings and metadata with Playwright
- How to scrape map-based local results with Playwright
- How to scrape sports scores and stats with Playwright
- How to scrape cryptocurrency prices with Playwright
- How to scrape deals and coupon codes with Playwright
- How to scrape to CSV with Playwright
- How to scrape to JSON Lines with Playwright
- How to scrape into a SQLite database with Playwright
- How to export scraped data to Excel with Playwright
- How to extract JSON-LD structured data with Playwright
- How to extract Open Graph and meta tags with Playwright
- How to extract links and build a crawl frontier in Playwright
- How to scrape RSS and Atom feeds with Playwright
- How to download images in bulk with Playwright
- How to extract clean article text with Playwright
- How to scrape a sitemap.xml with Playwright
- How to scrape into a pandas DataFrame with Playwright
- How to clean scraped prices and dates with Playwright
- Scrape search results by driving a form in Playwright
- Scrape a map-based search with Playwright
- Scrape autocomplete and typeahead inputs with Playwright
- Scrape date-picker calendars with Playwright
- Crawl list pages to detail pages with Playwright
- Scrape lazy-loaded images with Playwright
- Extract data from canvas charts with Playwright
- Scrape a multi-step wizard flow with Playwright
- How to resume an interrupted scrape with Playwright
- Incremental scraping: only new items since last run
- Handle 403 and 429 backoff mid-scrape in Playwright
- Scrape load-more button pages with Playwright
- Scrape nested pagination with Playwright
- Scrape an SPA that changes URL via history API
- Use BeautifulSoup with invisible_playwright
- Run stealth Playwright tests with pytest fixtures
- Run invisible_playwright concurrently with asyncio
- Run invisible_playwright in GitHub Actions CI
- Can you run invisible_playwright serverless?
- Run invisible_playwright in Celery task workers
- Schedule invisible_playwright scrapes with cron
- Run invisible_playwright headful on a server with Xvfb
- Use invisible_playwright in an Airflow DAG
- Combine invisible_playwright with httpx for speed
- Wrap invisible_playwright in a FastAPI service
- Run invisible_playwright in a Jupyter notebook
- Block images to speed up scraping (and when not to)
- Wait for a specific API response in Playwright
- How to scrape course catalogs with Playwright
- How to scrape store locator pages with Playwright
- How to scrape stock levels with Playwright
- How to scrape accordion and tab content with Playwright
- How to scrape size charts with Playwright
- How to scrape delivery slots with Playwright
- How to scrape appointment availability with Playwright
- How to scrape auction listings with Playwright
- How to scrape public transport timetables with Playwright
- How to scrape GraphQL endpoints with Playwright
- How to scrape virtual scrolling tables with Playwright
- How to scrape shipping rates with Playwright
- How to scrape cursor-based pagination with Playwright
- How to scrape multi-select facet filters with Playwright
- How to scrape currency exchange rates with Playwright
- How to scrape WebSocket streams with Playwright
- How to scrape book metadata with Playwright
- How to scrape professional directories with Playwright
- How to scrape range slider filters with Playwright
- How to scrape currency and locale switchers with Playwright
- How to scrape software changelogs and release notes with Playwright
- How to scrape breadcrumb hierarchies with Playwright
- How to scrape microdata and RDFa markup with Playwright
- How to scrape server-sent events with Playwright
- How to scrape open data portals with Playwright
- How to scrape infinite carousels with Playwright
- How to scrape printer-friendly pages with Playwright
- How to handle A/B test variants when scraping with Playwright
- How to scrape recipe data with Playwright
- How to scrape vehicle recall notices with Playwright
- How to scrape public tender notices with Playwright
- How to scrape nutrition labels with Playwright
- How to scrape podcast episode listings with Playwright
- How to scrape weather station data with Playwright
- How to scrape newsletter archives with Playwright
- How to scrape wine and spirits catalogs with Playwright
- How to scrape insurance quotes with Playwright
- How to scrape fitness class schedules with Playwright
- How to scrape flight seat maps with Playwright
- How to scrape concert and tour dates with Playwright
- How to scrape museum and gallery exhibition dates with Playwright
- How to scrape warranty terms with Playwright
- How to scrape sortable data tables with Playwright
- How to scrape salary and pay scale data with Playwright
- How to scrape live sports scores with Playwright
- How to scrape video game prices with Playwright
- How to scrape domain WHOIS records with Playwright
- How to scrape podcast transcripts with Playwright
- How to scrape patent listings with Playwright
- How to scrape clinical trial listings with Playwright
- How to Handle a PDF That Opens in a New Tab with Playwright
- Does Playwright Support Firefox Extensions?
- Automating an Email OTP / Verification-Link Login with Playwright
- Automating TOTP-Based 2FA Login with Playwright
- How to Scrape a Sandboxed Iframe with Playwright
Comparisons
- Playwright stealth in Python: three levels that work
- Firefox or Chromium for anti-detect automation
- Chromium is not Chrome, and detectors know the difference
- Playwright stealth vs Camoufox: two patched Firefoxes
- Playwright stealth vs Patchright: driver vs engine
- Playwright stealth vs undetected-chromedriver and nodriver
- playwright-stealth vs a patched engine: page vs browser
- puppeteer-extra-plugin-stealth: unmaintained since 2023
- selenium-stealth hasn't been updated since November 2020
- pyppeteer's own maintainer says to switch to Playwright
- invisible_playwright vs rebrowser-patches: the same CDP fix
- invisible_playwright vs fingerprint-suite: injection vs engine
- invisible_playwright vs playwright-with-fingerprints
- invisible_playwright vs Scrapling
- invisible_playwright vs Ulixee Hero
- invisible_playwright vs SeleniumBase UC Mode
- Splash is unmaintained, and it was never a real browser
- invisible_playwright vs DrissionPage
- WebDriver BiDi vs CDP: does the new protocol hide you
- invisible_playwright vs hrequests
- zendriver vs invisible_playwright: Chrome CDP vs Firefox
- botasaurus vs invisible_playwright: framework vs library
- curl_cffi vs invisible_playwright: TLS client vs browser
- pydoll vs invisible_playwright: CDP without a driver
- selenium-driverless vs invisible_playwright stealth
- puppeteer-real-browser vs invisible_playwright
- Migrating from Selenium to Playwright for stealth
- Migrating from Puppeteer to Playwright for stealth
- undetected-chromedriver vs a patched Firefox browser
- scrapy-playwright vs a patched Firefox for stealth
- playwright-extra stealth plugins vs a patched browser
- tls-client vs a real browser: when TLS is enough
- Anti-detect browser or Playwright stealth: which you need
- undetected-playwright vs a patched Firefox binary
- How to Read a Stealth-Browser Benchmark Without Being Misled
- Web Scraping Proxy Costs: Build vs. Buy Your Stealth Stack
- Why Playwright Locators Never Throw StaleElementReferenceException
Integrations
- Using invisible_playwright with CodeceptJS
- Using invisible_playwright with Crawlee for Python
- Using invisible_playwright with Crawlee for JavaScript
- Using invisible_playwright with scrapy-playwright
- Using invisible_playwright with Robot Framework Browser
- Cypress, WebdriverIO, TestCafe and Nightwatch integration
- Using invisible_playwright with Microsoft's Playwright MCP
- Using the engine from Go, Java, C#, Ruby and Rust
docs/ source folder