Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 

Repository files navigation

Web Scraping API in Python — Any URL to Clean Markdown/JSON

Scrape any page with one POST request — no proxy pools, no headless browsers, no HTML parsing. The API fetches the page (rendering JS when needed), strips the boilerplate and returns clean content.

Scrape a URL to markdown

import requests

API = "https://app.quantumproxies.io/api/v1/scraper/extract"
KEY = "qp_live_YOUR_KEY"

resp = requests.post(
    API,
    headers={"Authorization": f"Bearer {KEY}"},
    json={"url": "https://news.ycombinator.com", "format": "markdown", "country": "us"},
    timeout=120,
)
print(resp.json()["content"])   # article-quality markdown

JS-heavy pages

Add "render": true and the page runs in a real browser before extraction:

json={"url": "https://example-spa.com/products", "format": "markdown", "render": True}

Structured extraction (schema in, JSON out)

Describe the fields you want; get typed JSON back instead of markdown:

json={
    "url": "https://books.toscrape.com",
    "render": True,
    "extract": {
        "books": [{"title": "string", "price": "string"}]
    },
}
# -> resp.json()["data"]  == {"books": [{"title": "...", "price": "£..."}, ...]}

What you'd be replacing

The DIY stack for the same result: rotating proxies + retry logic + Playwright cluster + readability/boilerplate stripping + per-site selectors that break monthly. Here it's one endpoint, billed per successful request.

Runnable version: scrape.py

QP_API_KEY=qp_live_... python scrape.py

API access

This is the QuantumProxies Scraper API (part of the same platform as the proxy network — the scraper rides on the residential pool). Docs: quantumproxies.io/extract-api · keys: app.quantumproxies.io/api-keys.

About

Scrape any URL to clean markdown or structured JSON with one POST — rendering and anti-bot handled server-side.

Topics

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages