-
Notifications
You must be signed in to change notification settings - Fork 221
http2 fingerprint detection
The HTTP/2 fingerprint is the pattern a client reveals when it opens an HTTP/2 session, its SETTINGS frame, connection window update, priority tree and pseudo-header order, one signal layer above the JA3/JA4 TLS handshake, emitted by the networking engine before any script runs and unreachable from JavaScript. Everyone writes about JA3 and JA4; this is the next signal down, produced by the same part of the browser and just as far out of a script's reach. If you have matched the TLS handshake and are still refused before a page loads, this is the layer to look at next.
This page is what an HTTP/2 connection reveals, why no header spoof and no page-level patch can change it, what a plain HTTP library gives away that a real engine does not, and how to check your own.
The TLS handshake decides which stack you are before a byte of HTTP is sent. That is why a TLS fingerprint cannot be patched: the ClientHello is out the door before any script exists.
HTTP/2 sits immediately above it. Once the encrypted connection is up, the very first thing a client does is open the HTTP/2 session, and that opening exchange is not free text you compose. It is a sequence of binary frames the networking library emits on its own, with values baked into how that library was built and tuned. Two clients that both "speak HTTP/2" open the session differently, in ways that are stable per implementation and visible to the server on the very first round trip.
So there are two engine-bound fingerprints stacked on top of each other. The TLS one says which TLS library opened the socket. The HTTP/2 one says which HTTP stack is driving the connection. A server that checks both is asking the same question twice, and a stack that gets one right and the other wrong answers itself.
Four things travel in that opening exchange, and each is characteristic of the implementation.
- The SETTINGS frame. The client announces its parameters: header table size, whether server push is enabled, the maximum concurrent streams it will accept, the initial window size, the maximum frame size, the maximum header list size. The exact set present, their order, and the values chosen differ between a browser and a scripting library. A browser picks one recognisable profile; an HTTP library picks another.
- The initial WINDOW_UPDATE. Right after SETTINGS, most clients grow the connection level flow-control window by a fixed increment. The size of that bump is a per-stack constant.
- The priority tree. Older HTTP/2 clients build a dependency and weight structure for streams, and the shape of that tree, or its absence, is a strong tell. Browsers and libraries build very different trees, or none.
-
Pseudo-header order.
Every HTTP/2 request carries
:method,:authority,:schemeand:pathas pseudo-headers before the ordinary ones. The order in which a client emits those four is fixed per implementation, and it is one of the cheapest checks a server can run because it is present on every single request, not just the session opener.
None of these are things you set. They are emitted by the networking code the moment the session starts, the same way the ClientHello is emitted the moment the socket opens.
JavaScript cannot reach the HTTP/2 frame layer because those frames are emitted by the networking stack before any document or script exists, the same property the TLS handshake has and nothing else on the page shares.
navigator.webdriver is a value the browser reports, and a patch can change what it
reports. A canvas hash is an output the page produces, and a patch can shape the output.
The SETTINGS frame is neither. It is a property of the program that opened the
connection, sent before any document exists, and there is no API, init script or header
override that reaches it. By the time your code runs, the frames are already on the wire
and, if the server cared, already judged.
That is why extra_http_headers, a hand-set user agent, or any header-ordering trick
cannot help here. Those operate on the ordinary headers you compose. The HTTP/2 frame
layer underneath them is composed by the engine. You can dress the request perfectly and
still announce, one layer down, that a scripting library is the thing sending it. The
same reasoning that makes Sec-Fetch and client hints have
to agree with the engine applies here with no override at all: there is not even a knob
to get wrong.
The clearest way to see the layer is to send an HTTP/2 request from something that is not a browser and read back what the server saw. A public HTTP/2 fingerprint endpoint returns the frames it received as JSON.
pip install "httpx[http2]"import httpx
# A scripting HTTP client. It speaks HTTP/2 correctly and is not a browser.
with httpx.Client(http2=True) as client:
r = client.get("https://example.com/")
print(r.http_version) # "HTTP/2"The request above is valid HTTP/2. It is also unmistakable: the SETTINGS values, the window increment and the pseudo-header order belong to that library's HTTP/2 implementation, not to any browser. You can set the user agent to a real Firefox string, copy a browser's header order byte for byte, and it changes nothing one layer down. The frames still say "scripting library".
This is the HTTP/2 twin of why a plain requests scraper is blocked before it sends a header. The user agent is a string you write. The handshake and the frames are not.
A patched-but-real browser opens the HTTP/2 session with the engine's own networking stack, so the SETTINGS frame, the window update, the priority tree and the pseudo-header order are the engine's, because they are the engine. There is nothing to impersonate and no table of frame templates to keep current, in the same way the TLS stack here is left untouched so the handshake is a genuine Firefox handshake rather than an approximation.
Drive the browser to the same endpoint and read what it saw:
import json
from invisible_playwright import InvisiblePlaywright
# seed=42 -> the same identity every run, so a network check is reproducible
with InvisiblePlaywright(seed=42) as browser:
page = browser.new_page()
page.goto("https://example.com/http2-check") # a page that echoes the frames it received
report = page.evaluate("() => document.body.innerText")
print(report)The browser object is a real Playwright Browser, so this is ordinary Playwright once
it is launched. The point is what the endpoint reports: the HTTP/2 profile of a real
Firefox connection, not a library's.
The right way to read the result is the same rule as everywhere else in this set: do not trust that it "looks like a browser", compare it against a stock browser of the same version on the same machine, field by field.
import json
from invisible_playwright import InvisiblePlaywright
# Read the HTTP/2 report as structured data, then diff it against a stock
# Firefox of the same version opened by hand on the same machine.
with InvisiblePlaywright(seed=42) as browser:
page = browser.new_page()
page.goto("https://example.com/http2-check.json")
ours = json.loads(page.evaluate("() => document.body.innerText"))
print("SETTINGS:", ours.get("settings"))
print("WINDOW_UPDATE:", ours.get("window_update"))
print("pseudo-header order:", ours.get("pseudo_header_order"))
# Every one of these must match the stock browser's, not merely resemble a browser's.If the HTTP/2 profile matches stock Firefox exactly and the JA4 string matches too, the whole network layer is consistent with the browser the user agent claims. If either diverges, that divergence is the tell, and it is decided before any page renders.
It is worth being concrete about how small a network-layer delta a fingerprinter will catch, because the HTTP/2 layer has the same sensitivity as the TLS layer beneath it.
On this project, a same-IP, same-version comparison against a stock build once turned up a real ClientHello difference: the build offered one extra cipher suite that stock Firefox of the same version does not. JA3 and JA4 diverged accordingly. The cause was not the TLS code, which was never touched. It was a single boolean preference whose default is gated by release channel: upstream had moved that default to off for release builds, and the fork's copy of the pref declaration had not been carried forward past that change, so it still resolved to on. A production site fingerprinting TLS handshakes treated the one-extra-cipher ClientHello as an instant tell, on a connection that had not sent a byte of HTTP yet.
The fix was one line, forcing that preference back to its upstream-current default, after which the ClientHello, JA3 and JA4 measured byte-identical to stock. The lesson generalises straight to HTTP/2: a single value out of place in the SETTINGS frame is the same kind of delta, checked at the same pre-JavaScript moment, and the only durable defence is a repeated parity check against the currently shipped upstream release rather than a one-time claim that the stack is real.
The HTTP/2 fingerprint is the layer above the TLS handshake and below everything a page can touch. Its SETTINGS values, window update, priority tree and pseudo-header order are emitted by the networking stack on the first round trip, so a header spoof cannot hide them and a page-level patch cannot reach them. An HTTP library announces its own HTTP/2 profile no matter what user agent it wears; a real browser engine announces the browser's. The only way to make the frames Firefox's is for the connection to be opened by Firefox. Check yours the same way you check JA4: read the frames from the endpoint, and diff them against a stock browser rather than reading them as a verdict.
Can I change my HTTP/2 fingerprint in Playwright? No. The SETTINGS frame and the pseudo-header order are emitted by the networking stack when the session opens, before any script runs, so there is nothing in Playwright or JavaScript to override.
Does setting extra_http_headers or fixing header order fix it? No. Those act on the ordinary headers you compose. The HTTP/2 frame layer underneath is composed by the engine and is a separate fingerprint entirely.
Why does my requests or httpx scraper get blocked with a perfect user agent? Because the user agent is a string you set and the HTTP/2 frames are not. The library emits its own SETTINGS and pseudo-header order, which no header spoof hides.
Is HTTP/2 fingerprinting the same as JA3 or JA4? No, it is one layer up. JA3 and JA4 fingerprint the TLS handshake; the HTTP/2 fingerprint reads the frames sent right after it. A server often checks both.
How do I test my HTTP/2 fingerprint? Send a request to a public HTTP/2 fingerprint endpoint from the browser or client you deploy, then from a stock browser of the same version on the same machine, and compare the SETTINGS, window update and pseudo-header order field by field.
Does a residential proxy change my HTTP/2 fingerprint? A SOCKS5 proxy forwards the TCP stream, so your frames arrive intact and unchanged. Only a proxy that terminates the connection and re-opens HTTP/2 itself would replace the fingerprint with its own.
- The HTTP/2 framing described here is the ordinary session-opening exchange defined by the protocol: SETTINGS, WINDOW_UPDATE, stream priority and the request pseudo-headers.
- This project's own network-layer parity work, including the closed cipher-suite delta measured against a stock build of the same version and re-checked until the handshake fingerprints matched byte for byte.
- Public HTTP/2 and TLS fingerprint checking endpoints, read from the frames they echo back rather than from a rendered score.
See also: why a TLS fingerprint cannot be patched for the layer directly beneath this one, why a plain requests scraper is blocked before it sends a header for the non-browser version of the same problem, and the checklist for being detected on one site, where the network layer is step six.
Written while maintaining invisible_playwright, a Firefox patched at the C++ level driven by stock Playwright. The networking stack is one of the parts left deliberately untouched, so the HTTP/2 frames are the engine's own.
Documentation
Guides
-
Browser Identity
- navigator.webdriver is not the tell you think it is
- hardwareConcurrency, deviceMemory and storage quota
- Screen size and viewport tells in headless browsers
- Playwright headless vs headed: what detectors see
- Playwright User Agent: Why You Should Not Set It
- Client Hints and Sec-Fetch: headers that must agree
- Codec fingerprinting: canPlayType and MediaCapabilities
- Permissions API: the two answers that must agree
- CSS fingerprinting: what media queries reveal
- What privacy.resistFingerprinting actually does
- speechSynthesis.getVoices() returns an empty array
- Browser extensions are a fingerprint surface
- BFCache and pageshow.persisted under browser automation
- Service workers, storage partitioning and automation
- Web Workers: where page-level fingerprint patches fail
- fake-useragent is archived: what changes and what doesn't
- navigator.buildID and the stale build date tell
- navigator.maxTouchPoints and pointer consistency
- navigator.platform and oscpu on a spoofed OS
- navigator.vendor and productSub: the Firefox tells
- Accept-Language header vs navigator.languages
- window.devicePixelRatio: the pref that spoofs it
- Can you be fingerprinted in incognito mode?
- Is changing the user agent enough to avoid detection?
- Can a website tell you are running on a server?
- Can two devices share a browser fingerprint?
- Does clearing cookies stop fingerprint tracking?
- Color-gamut and HDR media queries as a fingerprint
- Battery API fingerprint: does Firefox expose it?
- Is navigator.connection a fingerprint in Firefox?
- Can the Gamepad API fingerprint or detect a bot?
- Do accelerometer and gyroscope APIs leak on desktop?
- prefers-reduced-motion and other OS-setting tells
- Does storage quota estimate reveal disk size?
- Can scrollbar width reveal my operating system?
-
Canvas, WebGL, Fonts and Audio
- Canvas fingerprint noise: why per-call randomising fails
- Firefox WebGL renderer strings: what ANGLE reports
- WebGL parameters: the numbers are the same on every GPU
- Your renderer string says NVIDIA. Your pixels say software.
- Why headless browsers render different fonts
- How to make Linux and macOS report real Windows fonts
- measureText and TextMetrics as a fingerprinting surface
- AudioContext fingerprinting, and why adding noise backfired
- Canvas and WebGL fingerprints, identical across OSes
- Emoji fingerprinting: why emoji look the same on any OS
- Detecting installed fonts in JavaScript by width
- WebGL shader precision as a fingerprint surface
- AudioContext sampleRate and latency as a fingerprint
- Is WebGPU a browser fingerprint?
-
Network, Proxy and WebRTC
- WebRTC leak with a proxy in Playwright and Selenium
- WebRTC ICE candidate spoofing: the fields that give it away
- Playwright proxy in Python: per-context, and what leaks
- Playwright proxy not working? SOCKS5 auth in Python
- Playwright timezone does not match the proxy IP
- JA3 and JA4: why a TLS fingerprint cannot be patched
- Playwright in Docker: it runs, and still gets blocked
- Web scraping keeps getting blocked with good proxies
- Python web scraping blocked? The TLS fingerprint reason
- SOCKS5 vs HTTP proxy: what each does in the browser
- WebRTC IPv6 leak: why a proxy does not stop it
- HTTP/2 fingerprint: the layer above the TLS handshake
- TLS fingerprint vs User-Agent: the contradiction
- WebRTC has no ICE candidates behind a proxy
- WebRTC IP that matches the proxy exit, by design
- How to check if a proxy leaks your real IP
- about:webrtc: read your real ICE candidates
- Offline timezone resolution from a proxy exit IP
- Residential vs datacenter vs mobile proxies explained
- Sticky vs rotating proxy sessions: which to use
- Does a proxy leak DNS? DoH and DNS leaks explained
- HTTP/3 and QUIC fingerprint: what a site sees
- What is ASN and IP reputation in bot detection?
- What does a mobile carrier IP look like to a site?
- IPv6 vs IPv4: which does your proxy expose?
- Geolocation API vs IP location: keep them consistent
- Does chaining two proxies help avoid detection?
-
The Automation Layer
- Function.prototype.toString and the [native code] check
- The ChromeDriver
cdc_variable, and why renaming it fails - Why an attached debugger makes automation detectable
- Execution context was destroyed, and when it means detection
- Human-like mouse movement: Bezier curves are the easy part
- Why a Playwright upgrade broke 97 of 133 tests overnight
- Playwright persistent profile: what it fixes and breaks
- Why humanized mouse movement can fail on hover()
- Why content_frame() returns None for a cross-origin iframe
- Orphaned Firefox processes on Windows: the killed-runner leak
- Firefox launches but Playwright can't drive it: packaging gap
- Why automating login is riskier than reusing a session
- Playwright new_page vs new_context: the viewport tell
- Playwright dialog and popup handling without a tell
- Playwright download files with Firefox and the tell
- Playwright connect_over_cdp does not work with Firefox
- Playwright mobile emulation on Firefox and isMobile
- Playwright isTrusted: are automated clicks real?
- Playwright set_input_files uploads and the tell
- Can websites detect Playwright? What is actually visible
- Does Playwright Set navigator.webdriver to True?
- Does Playwright Leave Traces a Website Can See?
- Does Playwright Change My Browser Fingerprint?
- Can I Use My Real Browser Profile With Playwright?
- Does Playwright Support Firefox Stealth?
- Is Playwright Firefox Harder to Detect Than Chromium?
- Does Playwright Get Detected on the First Request?
- Why Playwright's bundled Firefox is easy to detect
- ghost-cursor human mouse paths with Playwright
- Stock Playwright, patched Firefox: how they connect
- Intercept and mock network requests with page.route
- Record and replay HTTP traffic with HAR in Playwright
- Record a Playwright trace to debug a failed scrape
- Record a video of a Playwright browser session
- Save and reuse login with storage_state in Playwright
- Read and set cookies in a Playwright context
- Set geolocation and permissions per Playwright context
- Handle HTTP basic auth in Playwright (http_credentials)
- Isolate identities with a browser context per session
- Drag and drop elements in Playwright with drag_to
- When to use an HTTP client vs a real browser
- Migrating from requests + BeautifulSoup to a browser
-
AI Agents and Frameworks
- AI browser agents and stealth: what fits and what does not
- browser-use gets detected: what you can and cannot change
- crawl4ai stealth mode and custom browser engines
- Give a LangChain agent an invisible_playwright browser
- Feed invisible_playwright pages into a RAG index
- Computer-use agents and browser fingerprint detection
- Give an MCP browser server a stealth Firefox engine
- Give each AI agent a reproducible browser identity
- Run parallel browser agents with distinct fingerprints
- Why AI browser agents have their own timing signal
- Running an AI browser agent headless on a server
- Give a browser agent a persistent logged-in session
- smolagents: hand the agent an invisible_playwright tool
- Stagehand and stealth: why a Firefox engine won't drop in
- DOM-reading vs screenshot agents: which stealth helps
- Back a computer-use agent with a real browser engine
- AI agent retry loops trip rate limits, not fingerprints
-
Detectors, Explained
- What bot.sannysoft.com actually checks, row by row
- How CreepJS decides you are lying
- What BotD actually detects, and what it does not
- Why a FingerprintJS visitor ID changes
- reCAPTCHA v3 score: why a fresh browser scores badly
- BrowserLeaks canvas and WebGL hash, explained
- What BrowserLeaks actually tests, surface by surface
- Browser trust scores explained: what the number means
- How do websites detect bots?
- What is a browser fingerprint?
- What data does a website collect about your browser?
- Does a VPN stop browser fingerprinting?
- Do websites know you are using a script?
- How accurate is browser fingerprinting?
- Can a website detect a virtual machine?
- Can websites detect a datacenter or proxy IP?
- getClientRects fingerprinting: subpixel geometry as ID
- Notification.permission as a bot-detection signal
- speechSynthesis voices as a cross-platform fingerprint
- Can a website detect typing by keystroke timing?
- Can a website detect Clipboard API access?
- What are mouse-dynamics behavioural biometrics?
-
Testing and Troubleshooting
- How to test bot detection without a false pass
- Playwright detected as a bot: the checklist to fix it
- Firefox preferences that silently do nothing
- Slow browser launch: a per-request timeout is not a budget
- Playwright screenshot returns noise: readback fix
- Canvas fingerprint changes every run: use a seed
- Playwright TargetClosedError: the causes and the fixes
- Why am I blocked with a clean fingerprint?
- Why Does My Playwright Script Get Blocked?
- Is Playwright headless detectable? What sites check
- Can You Run Playwright Without Being Detected?
- Why Playwright Works Locally but Fails in the Cloud
- Does Playwright Trigger reCAPTCHA More Often?
-
Scraping with Playwright
- How to scrape without getting blocked
- How to scrape a site that blocks headless browsers
- How to scrape infinite scroll pages with Playwright
- How to rotate proxies when scraping with Playwright
- How to scrape data behind a login with Playwright
- How to run Playwright in Docker without getting detected
- How to use invisible_playwright in Docker
- Playwright bot detection: how to avoid it in Python
- How to scrape paginated pages with Playwright
- How to download files with Playwright
- How to upload files with Playwright, and verify it landed
- How to handle cookie consent banners in Playwright
- How to handle popups and modals in Playwright
- How to take full-page screenshots with Playwright
- How to generate a PDF with Playwright and Firefox
- How to wait for content to load in Playwright
- How to retry failed requests when scraping Playwright
- How to scrape pages in parallel with Playwright
- How to rate limit your own Playwright scraper
- How to scrape HTML tables with Playwright
- How to scrape iframe content with Playwright
- How to scrape shadow DOM content with Playwright
- How to capture XHR and API responses in Playwright
- How to scrape geotargeted content with Playwright
- How to scrape real estate listings with Playwright
- How to scrape job postings with Playwright
- How to scrape e-commerce product pages with Playwright
- How to track product prices with Playwright
- How to scrape hotel room prices with Playwright
- How to scrape flight prices with Playwright
- How to scrape classifieds listings with Playwright
- How to scrape vacation rental listings with Playwright
- How to scrape car listings with Playwright
- How to scrape apartment rentals with Playwright
- How to track product stock and restocks with Playwright
- How to scrape location-based store prices with Playwright
- How to scrape flexible-date fare calendars with Playwright
- How to scrape product reviews with Playwright
- How to scrape reviews and ratings with Playwright
- How to scrape news article text with Playwright
- How to scrape business directory listings with Playwright
- How to scrape event and ticket listings with Playwright
- How to scrape restaurant menu data with Playwright
- How to scrape stock and financial data with Playwright
- How to scrape social media profiles with Playwright
- How to scrape forum and community threads with Playwright
- How to scrape image galleries with Playwright
- How to scrape video listings and metadata with Playwright
- How to scrape map-based local results with Playwright
- How to scrape sports scores and stats with Playwright
- How to scrape cryptocurrency prices with Playwright
- How to scrape deals and coupon codes with Playwright
- How to scrape to CSV with Playwright
- How to scrape to JSON Lines with Playwright
- How to scrape into a SQLite database with Playwright
- How to export scraped data to Excel with Playwright
- How to extract JSON-LD structured data with Playwright
- How to extract Open Graph and meta tags with Playwright
- How to extract links and build a crawl frontier in Playwright
- How to scrape RSS and Atom feeds with Playwright
- How to download images in bulk with Playwright
- How to extract clean article text with Playwright
- How to scrape a sitemap.xml with Playwright
- How to scrape into a pandas DataFrame with Playwright
- How to clean scraped prices and dates with Playwright
- Scrape search results by driving a form in Playwright
- Scrape a map-based search with Playwright
- Scrape autocomplete and typeahead inputs with Playwright
- Scrape date-picker calendars with Playwright
- Crawl list pages to detail pages with Playwright
- Scrape lazy-loaded images with Playwright
- Extract data from canvas charts with Playwright
- Scrape a multi-step wizard flow with Playwright
- How to resume an interrupted scrape with Playwright
- Incremental scraping: only new items since last run
- Handle 403 and 429 backoff mid-scrape in Playwright
- Scrape load-more button pages with Playwright
- Scrape nested pagination with Playwright
- Scrape an SPA that changes URL via history API
- Use BeautifulSoup with invisible_playwright
- Run stealth Playwright tests with pytest fixtures
- Run invisible_playwright concurrently with asyncio
- Run invisible_playwright in GitHub Actions CI
- Can you run invisible_playwright serverless?
- Run invisible_playwright in Celery task workers
- Schedule invisible_playwright scrapes with cron
- Run invisible_playwright headful on a server with Xvfb
- Use invisible_playwright in an Airflow DAG
- Combine invisible_playwright with httpx for speed
- Wrap invisible_playwright in a FastAPI service
- Run invisible_playwright in a Jupyter notebook
- Block images to speed up scraping (and when not to)
- Wait for a specific API response in Playwright
Comparisons
- Playwright stealth in Python: three levels that work
- Firefox or Chromium for anti-detect automation
- Chromium is not Chrome, and detectors know the difference
- Playwright stealth vs Camoufox: two patched Firefoxes
- Playwright stealth vs Patchright: driver vs engine
- Playwright stealth vs undetected-chromedriver and nodriver
- playwright-stealth vs a patched engine: page vs browser
- puppeteer-extra-plugin-stealth: unmaintained since 2024
- selenium-stealth hasn't been updated since December 2021
- pyppeteer's own maintainer says to switch to Playwright
- invisible_playwright vs rebrowser-patches: the same CDP fix
- invisible_playwright vs fingerprint-suite: injection vs engine
- invisible_playwright vs playwright-with-fingerprints
- invisible_playwright vs Scrapling
- invisible_playwright vs Ulixee Hero
- invisible_playwright vs SeleniumBase UC Mode
- Splash is unmaintained, and it was never a real browser
- invisible_playwright vs DrissionPage
- WebDriver BiDi vs CDP: does the new protocol hide you
- invisible_playwright vs hrequests
- zendriver vs invisible_playwright: Chrome CDP vs Firefox
- botasaurus vs invisible_playwright: framework vs library
- curl_cffi vs invisible_playwright: TLS client vs browser
- pydoll vs invisible_playwright: CDP without a driver
- selenium-driverless vs invisible_playwright stealth
- puppeteer-real-browser vs invisible_playwright
- Migrating from Selenium to Playwright for stealth
- Migrating from Puppeteer to Playwright for stealth
- undetected-chromedriver vs a patched Firefox browser
- scrapy-playwright vs a patched Firefox for stealth
- playwright-extra stealth plugins vs a patched browser
- tls-client vs a real browser: when TLS is enough
- Anti-detect browser or Playwright stealth: which you need
- undetected-playwright vs a patched Firefox binary
Integrations
- Using invisible_playwright with CodeceptJS
- Using invisible_playwright with Crawlee for Python
- Using invisible_playwright with Crawlee for JavaScript
- Using invisible_playwright with scrapy-playwright
- Using invisible_playwright with Robot Framework Browser
- Cypress, WebdriverIO, TestCafe and Nightwatch integration
- Using invisible_playwright with Microsoft's Playwright MCP
- Using the engine from Go, Java, C#, Ruby and Rust
docs/ source folder