-
Notifications
You must be signed in to change notification settings - Fork 221
socks5 vs http proxy browser
The practical difference between a SOCKS5 and an HTTP proxy in the browser is who
authenticates and where, not speed. With a socks5:// URL the patched Firefox
engine opens the connection, speaks the authentication, and resolves DNS at the exit.
With an http:// URL the Playwright driver authenticates one layer up, and the
engine's proxy settings are never touched.
Most comparisons of these two proxy types argue about speed or overhead. That is the least interesting difference and almost never the one that decides whether your automation works. The difference that matters is structural: for one of them the patched browser engine makes the connection and authenticates itself, and for the other the authentication happens one layer up, in the driver, before the engine is involved at all.
This page is about that split. It is written for Playwright, it uses a real API, and the behaviour described is what the shipped build actually does when you hand it each kind of proxy URL.
Every row below is a property of the code path the URL scheme selects, not a tuning option you set separately. The scheme is the only switch.
| Property | SOCKS proxy (socks5://, socks4://, socks://) |
HTTP/HTTPS proxy (http://, https://) |
|---|---|---|
| Where auth happens | Connection layer, inside the SOCKS handshake | HTTP Basic auth, a Proxy-Authorization header |
| Who holds the credentials | The patched browser engine | The Playwright driver |
| Engine proxy prefs | Set directly (network.proxy.type = 1, host, port, version) |
Left untouched |
| DNS resolution | Forced at the exit (network.proxy.socks_remote_dns = true) |
Depends on the setup |
| Passed to Playwright | No proxy (the engine does the whole job) | The proxy dictionary, unchanged |
| Needed a source patch | Yes, to speak authenticated SOCKS5 | No, Basic auth was already handled |
Both proxy types move your traffic through an exit. The question that separates them is: who speaks the authentication handshake, and over which protocol?
- A SOCKS proxy (
socks5://,socks4://,socks://) authenticates at the connection layer, before any HTTP is spoken. The username and password are part of the SOCKS handshake itself. - An HTTP/HTTPS proxy (
http://,https://) authenticates with HTTP Basic auth, aProxy-Authorizationheader the client sends after it opens the connection.
Those are different mechanisms living at different layers, and in this tool they are handled by two different components. The scheme in the URL is the switch. Nothing else you configure changes which path runs.
When you pass a proxy, the wrapper looks at the URL scheme and routes it one of two ways.
For a socks5://, socks4:// or socks:// URL, the settings are written into the
patched engine directly: the proxy type is set to a manual SOCKS proxy
(network.proxy.type = 1), the host, port and SOCKS version are filled in, DNS is
forced to resolve at the exit rather than locally
(network.proxy.socks_remote_dns = true), and the credentials are handed to the
browser to speak as part of the SOCKS handshake. Playwright itself is then told there
is no proxy, because the engine is doing the whole job.
For an http:// or https:// URL, the opposite happens: the proxy dictionary is
passed through to Playwright unchanged, and Playwright negotiates HTTP Basic auth on
its own. That path never touches the engine's proxy preferences.
So the two schemes do not just differ in wire protocol. They differ in which piece of software is holding the credentials. SOCKS traffic is authenticated by the browser you are trying to make look real; HTTP proxy traffic is authenticated by the automation driver in front of it.
SOCKS5 authentication needed a source patch because stock Firefox only speaks SOCKS5 without credentials: given a SOCKS5 proxy that requires a username and password, an unmodified engine never performs the authenticated handshake, so any exit that demands auth refuses the connection. Most commercial residential and mobile exits demand auth, so on a stock engine, authenticated SOCKS5, which is the common case, simply did not work.
This build carries a C++ patch to the proxy service so the engine reads a SOCKS
username and password and includes them in the SOCKS5 handshake. That is the only
reason returning control to the engine is a valid strategy for SOCKS at all: without
the patch there would be nothing on the engine side to authenticate with, and the
credentials would have to be smuggled in some other way. With the patch, an
authenticated socks5://user:pass@exit:1080 is a first-class citizen, handled the
same way an unauthenticated one is.
HTTP proxies never needed this, because HTTP Basic proxy auth was already part of what the driver layer handles. That asymmetry is the whole reason the two schemes take two different code paths. For the SOCKS side specifically, see SOCKS5 proxy authentication in Playwright, which covers the URL format and the failure you get when auth is silently dropped.
The API is the same for both; only the scheme changes. The browser object is a real
Playwright Browser, so every method you already use works unchanged.
SOCKS5, authenticated:
from invisible_playwright import InvisiblePlaywright
proxy = {"server": "socks5://gate.example.com:1080", "username": "u", "password": "p"}
with InvisiblePlaywright(seed=42, proxy=proxy) as browser:
page = browser.new_page()
page.goto("https://example.com")
# DNS for example.com was resolved at the exit, not locally,
# because socks_remote_dns is forced on for SOCKS proxies.HTTP, authenticated:
from invisible_playwright import InvisiblePlaywright
proxy = {"server": "http://gate.example.com:8080", "username": "u", "password": "p"}
with InvisiblePlaywright(seed=42, proxy=proxy) as browser:
page = browser.new_page()
page.goto("https://example.com")
# Here Playwright negotiated HTTP Basic proxy auth itself;
# the engine's SOCKS preferences were never set.Do not assume the proxy took effect. Confirm the exit address from inside the browser, because a test that passes on localhost has measured the path you do not use:
with InvisiblePlaywright(seed=42, proxy=proxy) as browser:
page = browser.new_page()
# any endpoint that echoes the caller's IP; replace with your own
page.goto("https://example.com/ip")
print(page.inner_text("body"))A quick measurement worth doing once, so the abstract distinction becomes concrete:
drive the same exit through both a socks5:// URL and an http:// URL from the same
credentials, and read the exit IP inside the page each time. The address is identical,
as it must be, because it is the same exit. What differs is not visible in that
number: with SOCKS the resolution of example.com happened at the exit and the auth
was spoken by the engine, and with HTTP the driver authenticated to the proxy first.
The exit IP being equal is the point. It tells you both paths reach the same place;
which layer authenticated is a property of your setup, not of the exit.
For browser automation that has to look like a real user, prefer SOCKS5 when the exit offers it. Two reasons, both structural rather than about speed:
- The connection and its authentication are handled by the engine you spent effort making realistic, in one place, at the layer below HTTP. There is no second party inserting proxy headers into the conversation.
- Remote DNS is forced on, so hostnames resolve at the exit. A local resolution is a classic story mismatch: the browser claims to be somewhere the DNS lookup says it is not. See when the timezone does not match the proxy for the general shape of that failure and everything else that has to agree.
Reach for an HTTP/HTTPS proxy when that is all the exit gives you, or when you specifically want the driver-level path, for example because a piece of tooling around you already speaks HTTP proxying. It works, it authenticates, and for most sites it is indistinguishable at the destination. Just know that you are on a different code path, and that path does not exercise the engine's proxy handling at all.
Whichever you pick, the exit reputation and the WebRTC surface matter more than the scheme. A WebRTC path that leaks or comes back empty through a proxy will undo a perfectly authenticated tunnel, and it fails in both directions.
SOCKS5 versus HTTP is not a speed contest. It is a question of who authenticates and where. In this build a SOCKS URL is driven entirely by the patched engine, credentials and DNS included, which is only possible because the engine was patched to speak authenticated SOCKS5 in the first place; an HTTP URL is handled by the Playwright driver one layer up and never touches those engine preferences. Pick SOCKS when you can, confirm the exit from inside the browser rather than assuming it, and remember that the scheme decides the mechanism, not just the wire format.
Is SOCKS5 more anonymous than an HTTP proxy? Not inherently. Both send your traffic through an exit. The practical difference here is that SOCKS auth and DNS are handled by the browser engine itself, while HTTP proxy auth is handled by the driver above it.
Does authenticated SOCKS5 work in Firefox? In stock Firefox, no: it supports SOCKS5 only without credentials. This build carries a source patch so the engine reads a SOCKS username and password and includes them in the handshake.
Why does my SOCKS5 proxy with a password fail in a normal browser? Because unmodified Firefox performs the SOCKS5 handshake without credentials, so any exit that requires auth refuses the connection.
Will the two schemes give me a different exit IP? No. Through the same exit the IP is the same. What differs is which layer authenticated and where DNS resolved, not the address the site sees.
Do I need to set anything besides the URL to switch between them? No. The scheme in
the proxy URL is the only switch. A socks5:// URL takes the engine path, an
http:// URL takes the driver path, automatically.
Does an HTTP proxy leak DNS? It depends on the setup, but for the SOCKS path DNS is forced to resolve at the exit. Confirm your real exit and resolver from inside the browser rather than trusting the scheme alone.
- This project's proxy dispatch, which routes a proxy by its URL scheme to either the patched engine or the Playwright driver, read from its own implementation.
- The engine's SOCKS proxy handling, patched so an authenticated SOCKS5 handshake is performed with a username and password, described in this project's patch notes.
- Firefox's own proxy preferences (
network.proxy.type,network.proxy.socks_remote_dns), which are standardabout:configsettings. - The SOCKS protocol itself: SOCKS version 5 is defined in RFC 1928, and its username/password authentication method, the one the patch performs, is defined separately in RFC 1929.
- The HTTP side's
Proxy-Authorizationheader and the Basic authentication scheme it carries are documented on MDN's Proxy-Authorization reference.
See also: SOCKS5 proxy authentication in Playwright, rotating proxies across runs, and a different proxy per browser context.
Written while maintaining invisible_playwright, a Firefox patched at the C++ level driven by stock Playwright. The SOCKS5 authentication described here exists because the stock engine did not do it, and the patch is the reason the scheme can be handed back to the engine at all.
Documentation
Guides
-
Browser Identity
- navigator.webdriver is not the tell you think it is
- hardwareConcurrency, deviceMemory and storage quota
- Screen size and viewport tells in headless browsers
- Playwright headless vs headed: what detectors see
- Playwright User Agent: Why You Should Not Set It
- Client Hints and Sec-Fetch: headers that must agree
- Codec fingerprinting: canPlayType and MediaCapabilities
- Permissions API: the two answers that must agree
- CSS fingerprinting: what media queries reveal
- What privacy.resistFingerprinting actually does
- speechSynthesis.getVoices() returns an empty array
- Browser extensions are a fingerprint surface
- BFCache and pageshow.persisted under browser automation
- Service workers, storage partitioning and automation
- Web Workers: where page-level fingerprint patches fail
- fake-useragent is archived: what changes and what doesn't
- navigator.buildID and the stale build date tell
- navigator.maxTouchPoints and pointer consistency
- navigator.platform and oscpu on a spoofed OS
- navigator.vendor and productSub: the Firefox tells
- Accept-Language header vs navigator.languages
- window.devicePixelRatio: the pref that spoofs it
- Can you be fingerprinted in incognito mode?
- Is changing the user agent enough to avoid detection?
- Can a website tell you are running on a server?
- Can two devices share a browser fingerprint?
- Does clearing cookies stop fingerprint tracking?
- Color-gamut and HDR media queries as a fingerprint
- Battery API fingerprint: does Firefox expose it?
- Is navigator.connection a fingerprint in Firefox?
- Can the Gamepad API fingerprint or detect a bot?
- Do accelerometer and gyroscope APIs leak on desktop?
- prefers-reduced-motion and other OS-setting tells
- Does storage quota estimate reveal disk size?
- Can scrollbar width reveal my operating system?
-
Canvas, WebGL, Fonts and Audio
- Canvas fingerprint noise: why per-call randomising fails
- Firefox WebGL renderer strings: what ANGLE reports
- WebGL parameters: the numbers are the same on every GPU
- Your renderer string says NVIDIA. Your pixels say software.
- Why headless browsers render different fonts
- How to make Linux and macOS report real Windows fonts
- measureText and TextMetrics as a fingerprinting surface
- AudioContext fingerprinting, and why adding noise backfired
- Canvas and WebGL fingerprints, identical across OSes
- Emoji fingerprinting: why emoji look the same on any OS
- Detecting installed fonts in JavaScript by width
- WebGL shader precision as a fingerprint surface
- AudioContext sampleRate and latency as a fingerprint
- Is WebGPU a browser fingerprint?
-
Network, Proxy and WebRTC
- WebRTC leak with a proxy in Playwright and Selenium
- WebRTC ICE candidate spoofing: the fields that give it away
- Playwright proxy in Python: per-context, and what leaks
- Playwright proxy not working? SOCKS5 auth in Python
- Playwright timezone does not match the proxy IP
- JA3 and JA4: why a TLS fingerprint cannot be patched
- Playwright in Docker: it runs, and still gets blocked
- Web scraping keeps getting blocked with good proxies
- Python web scraping blocked? The TLS fingerprint reason
- SOCKS5 vs HTTP proxy: what each does in the browser
- WebRTC IPv6 leak: why a proxy does not stop it
- HTTP/2 fingerprint: the layer above the TLS handshake
- TLS fingerprint vs User-Agent: the contradiction
- WebRTC has no ICE candidates behind a proxy
- WebRTC IP that matches the proxy exit, by design
- How to check if a proxy leaks your real IP
- about:webrtc: read your real ICE candidates
- Offline timezone resolution from a proxy exit IP
- Residential vs datacenter vs mobile proxies explained
- Sticky vs rotating proxy sessions: which to use
- Does a proxy leak DNS? DoH and DNS leaks explained
- HTTP/3 and QUIC fingerprint: what a site sees
- What is ASN and IP reputation in bot detection?
- What does a mobile carrier IP look like to a site?
- IPv6 vs IPv4: which does your proxy expose?
- Geolocation API vs IP location: keep them consistent
- Does chaining two proxies help avoid detection?
-
The Automation Layer
- Function.prototype.toString and the [native code] check
- The ChromeDriver
cdc_variable, and why renaming it fails - Why an attached debugger makes automation detectable
- Execution context was destroyed, and when it means detection
- Human-like mouse movement: Bezier curves are the easy part
- Why a Playwright upgrade broke 97 of 133 tests overnight
- Playwright persistent profile: what it fixes and breaks
- Why humanized mouse movement can fail on hover()
- Why content_frame() returns None for a cross-origin iframe
- Orphaned Firefox processes on Windows: the killed-runner leak
- Firefox launches but Playwright can't drive it: packaging gap
- Why automating login is riskier than reusing a session
- Playwright new_page vs new_context: the viewport tell
- Playwright dialog and popup handling without a tell
- Playwright download files with Firefox and the tell
- Playwright connect_over_cdp does not work with Firefox
- Playwright mobile emulation on Firefox and isMobile
- Playwright isTrusted: are automated clicks real?
- Playwright set_input_files uploads and the tell
- Can websites detect Playwright? What is actually visible
- Does Playwright Set navigator.webdriver to True?
- Does Playwright Leave Traces a Website Can See?
- Does Playwright Change My Browser Fingerprint?
- Can I Use My Real Browser Profile With Playwright?
- Does Playwright Support Firefox Stealth?
- Is Playwright Firefox Harder to Detect Than Chromium?
- Does Playwright Get Detected on the First Request?
- Why Playwright's bundled Firefox is easy to detect
- ghost-cursor human mouse paths with Playwright
- Stock Playwright, patched Firefox: how they connect
- Intercept and mock network requests with page.route
- Record and replay HTTP traffic with HAR in Playwright
- Record a Playwright trace to debug a failed scrape
- Record a video of a Playwright browser session
- Save and reuse login with storage_state in Playwright
- Read and set cookies in a Playwright context
- Set geolocation and permissions per Playwright context
- Handle HTTP basic auth in Playwright (http_credentials)
- Isolate identities with a browser context per session
- Drag and drop elements in Playwright with drag_to
- When to use an HTTP client vs a real browser
- Migrating from requests + BeautifulSoup to a browser
-
AI Agents and Frameworks
- AI browser agents and stealth: what fits and what does not
- browser-use gets detected: what you can and cannot change
- crawl4ai stealth mode and custom browser engines
- Give a LangChain agent an invisible_playwright browser
- Feed invisible_playwright pages into a RAG index
- Computer-use agents and browser fingerprint detection
- Give an MCP browser server a stealth Firefox engine
- Give each AI agent a reproducible browser identity
- Run parallel browser agents with distinct fingerprints
- Why AI browser agents have their own timing signal
- Running an AI browser agent headless on a server
- Give a browser agent a persistent logged-in session
- smolagents: hand the agent an invisible_playwright tool
- Stagehand and stealth: why a Firefox engine won't drop in
- DOM-reading vs screenshot agents: which stealth helps
- Back a computer-use agent with a real browser engine
- AI agent retry loops trip rate limits, not fingerprints
-
Detectors, Explained
- What bot.sannysoft.com actually checks, row by row
- How CreepJS decides you are lying
- What BotD actually detects, and what it does not
- Why a FingerprintJS visitor ID changes
- reCAPTCHA v3 score: why a fresh browser scores badly
- BrowserLeaks canvas and WebGL hash, explained
- What BrowserLeaks actually tests, surface by surface
- Browser trust scores explained: what the number means
- How do websites detect bots?
- What is a browser fingerprint?
- What data does a website collect about your browser?
- Does a VPN stop browser fingerprinting?
- Do websites know you are using a script?
- How accurate is browser fingerprinting?
- Can a website detect a virtual machine?
- Can websites detect a datacenter or proxy IP?
- getClientRects fingerprinting: subpixel geometry as ID
- Notification.permission as a bot-detection signal
- speechSynthesis voices as a cross-platform fingerprint
- Can a website detect typing by keystroke timing?
- Can a website detect Clipboard API access?
- What are mouse-dynamics behavioural biometrics?
-
Testing and Troubleshooting
- How to test bot detection without a false pass
- Playwright detected as a bot: the checklist to fix it
- Firefox preferences that silently do nothing
- Slow browser launch: a per-request timeout is not a budget
- Playwright screenshot returns noise: readback fix
- Canvas fingerprint changes every run: use a seed
- Playwright TargetClosedError: the causes and the fixes
- Why am I blocked with a clean fingerprint?
- Why Does My Playwright Script Get Blocked?
- Is Playwright headless detectable? What sites check
- Can You Run Playwright Without Being Detected?
- Why Playwright Works Locally but Fails in the Cloud
- Does Playwright Trigger reCAPTCHA More Often?
-
Scraping with Playwright
- How to scrape without getting blocked
- How to scrape a site that blocks headless browsers
- How to scrape infinite scroll pages with Playwright
- How to rotate proxies when scraping with Playwright
- How to scrape data behind a login with Playwright
- How to run Playwright in Docker without getting detected
- How to use invisible_playwright in Docker
- Playwright bot detection: how to avoid it in Python
- How to scrape paginated pages with Playwright
- How to download files with Playwright
- How to upload files with Playwright, and verify it landed
- How to handle cookie consent banners in Playwright
- How to handle popups and modals in Playwright
- How to take full-page screenshots with Playwright
- How to generate a PDF with Playwright and Firefox
- How to wait for content to load in Playwright
- How to retry failed requests when scraping Playwright
- How to scrape pages in parallel with Playwright
- How to rate limit your own Playwright scraper
- How to scrape HTML tables with Playwright
- How to scrape iframe content with Playwright
- How to scrape shadow DOM content with Playwright
- How to capture XHR and API responses in Playwright
- How to scrape geotargeted content with Playwright
- How to scrape real estate listings with Playwright
- How to scrape job postings with Playwright
- How to scrape e-commerce product pages with Playwright
- How to track product prices with Playwright
- How to scrape hotel room prices with Playwright
- How to scrape flight prices with Playwright
- How to scrape classifieds listings with Playwright
- How to scrape vacation rental listings with Playwright
- How to scrape car listings with Playwright
- How to scrape apartment rentals with Playwright
- How to track product stock and restocks with Playwright
- How to scrape location-based store prices with Playwright
- How to scrape flexible-date fare calendars with Playwright
- How to scrape product reviews with Playwright
- How to scrape reviews and ratings with Playwright
- How to scrape news article text with Playwright
- How to scrape business directory listings with Playwright
- How to scrape event and ticket listings with Playwright
- How to scrape restaurant menu data with Playwright
- How to scrape stock and financial data with Playwright
- How to scrape social media profiles with Playwright
- How to scrape forum and community threads with Playwright
- How to scrape image galleries with Playwright
- How to scrape video listings and metadata with Playwright
- How to scrape map-based local results with Playwright
- How to scrape sports scores and stats with Playwright
- How to scrape cryptocurrency prices with Playwright
- How to scrape deals and coupon codes with Playwright
- How to scrape to CSV with Playwright
- How to scrape to JSON Lines with Playwright
- How to scrape into a SQLite database with Playwright
- How to export scraped data to Excel with Playwright
- How to extract JSON-LD structured data with Playwright
- How to extract Open Graph and meta tags with Playwright
- How to extract links and build a crawl frontier in Playwright
- How to scrape RSS and Atom feeds with Playwright
- How to download images in bulk with Playwright
- How to extract clean article text with Playwright
- How to scrape a sitemap.xml with Playwright
- How to scrape into a pandas DataFrame with Playwright
- How to clean scraped prices and dates with Playwright
- Scrape search results by driving a form in Playwright
- Scrape a map-based search with Playwright
- Scrape autocomplete and typeahead inputs with Playwright
- Scrape date-picker calendars with Playwright
- Crawl list pages to detail pages with Playwright
- Scrape lazy-loaded images with Playwright
- Extract data from canvas charts with Playwright
- Scrape a multi-step wizard flow with Playwright
- How to resume an interrupted scrape with Playwright
- Incremental scraping: only new items since last run
- Handle 403 and 429 backoff mid-scrape in Playwright
- Scrape load-more button pages with Playwright
- Scrape nested pagination with Playwright
- Scrape an SPA that changes URL via history API
- Use BeautifulSoup with invisible_playwright
- Run stealth Playwright tests with pytest fixtures
- Run invisible_playwright concurrently with asyncio
- Run invisible_playwright in GitHub Actions CI
- Can you run invisible_playwright serverless?
- Run invisible_playwright in Celery task workers
- Schedule invisible_playwright scrapes with cron
- Run invisible_playwright headful on a server with Xvfb
- Use invisible_playwright in an Airflow DAG
- Combine invisible_playwright with httpx for speed
- Wrap invisible_playwright in a FastAPI service
- Run invisible_playwright in a Jupyter notebook
- Block images to speed up scraping (and when not to)
- Wait for a specific API response in Playwright
Comparisons
- Playwright stealth in Python: three levels that work
- Firefox or Chromium for anti-detect automation
- Chromium is not Chrome, and detectors know the difference
- Playwright stealth vs Camoufox: two patched Firefoxes
- Playwright stealth vs Patchright: driver vs engine
- Playwright stealth vs undetected-chromedriver and nodriver
- playwright-stealth vs a patched engine: page vs browser
- puppeteer-extra-plugin-stealth: unmaintained since 2024
- selenium-stealth hasn't been updated since December 2021
- pyppeteer's own maintainer says to switch to Playwright
- invisible_playwright vs rebrowser-patches: the same CDP fix
- invisible_playwright vs fingerprint-suite: injection vs engine
- invisible_playwright vs playwright-with-fingerprints
- invisible_playwright vs Scrapling
- invisible_playwright vs Ulixee Hero
- invisible_playwright vs SeleniumBase UC Mode
- Splash is unmaintained, and it was never a real browser
- invisible_playwright vs DrissionPage
- WebDriver BiDi vs CDP: does the new protocol hide you
- invisible_playwright vs hrequests
- zendriver vs invisible_playwright: Chrome CDP vs Firefox
- botasaurus vs invisible_playwright: framework vs library
- curl_cffi vs invisible_playwright: TLS client vs browser
- pydoll vs invisible_playwright: CDP without a driver
- selenium-driverless vs invisible_playwright stealth
- puppeteer-real-browser vs invisible_playwright
- Migrating from Selenium to Playwright for stealth
- Migrating from Puppeteer to Playwright for stealth
- undetected-chromedriver vs a patched Firefox browser
- scrapy-playwright vs a patched Firefox for stealth
- playwright-extra stealth plugins vs a patched browser
- tls-client vs a real browser: when TLS is enough
- Anti-detect browser or Playwright stealth: which you need
- undetected-playwright vs a patched Firefox binary
Integrations
- Using invisible_playwright with CodeceptJS
- Using invisible_playwright with Crawlee for Python
- Using invisible_playwright with Crawlee for JavaScript
- Using invisible_playwright with scrapy-playwright
- Using invisible_playwright with Robot Framework Browser
- Cypress, WebdriverIO, TestCafe and Nightwatch integration
- Using invisible_playwright with Microsoft's Playwright MCP
- Using the engine from Go, Java, C#, Ruby and Rust
docs/ source folder