Skip to content

Releases: dacrypt/openquery

v1.4.0 — 562 Sources, EV Ecosystem, Vehicle Tax

07 Apr 06:12

Choose a tag to compare

OpenQuery v1.4.0

562 public data sources across 21 countries.

What's New

EV Charging Infrastructure (5 new)

  • intl.ocm — Open Charge Map: 500K+ stations worldwide
  • intl.osm_ev — OpenStreetMap EV stations via Overpass API
  • us.afdc — DOE Alternative Fuels Station Locator (US/Canada)
  • br.aneel_ev — ANEEL registered EV stations (Brazil)
  • co.estaciones_ev_epm — EPM public EV stations (Colombia)

EV & Vehicle Ecosystem (8 new)

  • intl.fuel_prices — World Bank fuel prices (130+ countries)
  • intl.ev_specs — Open EV Data battery/range specs
  • intl.electricity_maps — Carbon intensity real-time
  • intl.iea_ev — IEA global EV sales, stock, market share
  • us.eia — US electricity prices by state
  • us.carquery — Vehicle specs (49K+ vehicles, no auth)
  • co.combustible_precios — Colombian fuel prices by city
  • co.peajes_tarifas — Colombian toll tariffs

Colombian Vehicle Tax (15 new)

Impuesto vehicular for all major departments:
Bogota, Antioquia, Valle, Cundinamarca, Atlantico, Santander, Bolivar, Norte de Santander, Boyaca, Narino, Risaralda, Caldas, Tolima, Huila, Meta

Vehicle Sales Statistics (6 new)

  • co.runt_estadisticas — RUNT fleet stats by brand (Socrata)
  • us.auto_sales — FRED total vehicle sales
  • mx.inegi_vehiculos — INEGI vehicle registration stats
  • br.anfavea — ANFAVEA production/licensing
  • ar.dnrpa_estadisticas — DNRPA stats by province
  • intl.oica — OICA global production/sales

Infrastructure

  • Live SUI electricity tariffs (co.sui_tarifas) with Imperva bypass
  • All 21 countries now at 15+ sources minimum
  • Stealth browser with WAF/CAPTCHA auto-handling

By Country

Country Sources Country Sources
CO 137 VE 16
BR 41 BO-UY 15 each
US 35 (11 countries)
INTL 33
PE 33
MX 28
AR 26
CL 26
EC 22

Install

pip install openquery==1.4.0

EV Quick Start

# Find EV chargers near you
openquery query intl.ocm --custom search -e '{"country":"CO","city":"Bogota"}'

# EV specs
openquery query intl.ev_specs --custom search -e '{"brand":"Tesla","model":"Model 3"}'

# Fuel prices by country
openquery query intl.fuel_prices --custom search -e '{"country":"CO","fuel_type":"gasoline"}'

# Vehicle tax by department
openquery query co.impuesto_vehicular_bogota --placa ABC123

v1.3.0 — Stealth Infrastructure + Live Accountability

06 Apr 22:07

Choose a tag to compare

OpenQuery v1.3.0

500 sources, 21 countries, 79 live-verified.

Stealth Infrastructure

This release adds comprehensive anti-detection infrastructure so OpenQuery can access government sites the same way a real user would:

  • Randomized browser fingerprints — rotates between 4 Chrome/Firefox user agents
  • Country-aware locale — 20 country locales mapped (es-CO, pt-BR, en-US, etc.)
  • Auto cookie banner dismissal — handles GDPR/consent popups automatically
  • Cloudflare/Akamai/Imperva challenge wait — auto-resolves WAF challenges (10s)
  • Auto-CAPTCHA — detects and solves CAPTCHAs on every page when solver is configured
  • SSL bypassOPENQUERY_SSL_VERIFY=false for .gob.ve/.gob.py sites with bad certs
  • httpx helperopenquery.core.http.get_client() with UA rotation and SSL bypass

Configuration for Maximum Access

# Residential proxy (unlocks WAF-blocked sources)
export OPENQUERY_PROXY_URL=http://user:pass@proxy.example.com:8080

# CAPTCHA solver (unlocks reCAPTCHA/hCaptcha sources)
export OPENQUERY_CAPSOLVER_API_KEY=your-key

# SSL bypass (for government sites with expired certs)
export OPENQUERY_SSL_VERIFY=false

Live Accountability

Category Tested OK Rate
API sources 104 47+ 45-60%
CO browser 15 14 93%
Cross-country browser 23 18 78%
Total 142 79 56%

Most "failures" are external (WAF/geo-blocking from datacenter IP), not code bugs. With a residential proxy configured, success rate jumps significantly.

Install

pip install openquery==1.3.0

v1.2.0 — 500 Sources, 21 Countries

06 Apr 14:50

Choose a tag to compare

OpenQuery v1.2.0 — 500 Sources!

500 public data sources across 21 countries and regions.

The most comprehensive open-source public data query library for the Americas.

By Country

Country Sources Country Sources
CO 103 VE 16
BR 35 PA 14
US 30 BO 13
PE 24 DO 13
CL 23 SV 13
MX 23 CR 11
INTL 23 GT 12
AR 20 HN 12
EC 20 NI 12
PY 11
UY 12
PR 11

By Category

Vehicle (79), Tax/Finance (85), Identity (43), Company (40), Data/Stats (35), Court (23), Health (20), Property (16), Sanctions (16), Education (4), Environment (3), Labor (3), and 100+ specialized sources.

Quality

  • 5,028 tests, 0 failures
  • Lint clean (ruff)
  • CI green on all platforms
  • 58 API sources live-verified

Install

pip install openquery==1.2.0

v1.1.0 — 400 Sources, 21 Countries

06 Apr 12:21

Choose a tag to compare

OpenQuery v1.1.0

400 public data sources across 21 countries and regions.

What's New Since v1.0.0

+100 new sources in a single development sprint:

Vehicle Sources (17 new)

  • AR: sinai (national infractions), vtv (inspection), ssn_seguro (insurance), ceta (transfer cert)
  • PE: sutran (infractions), soat (insurance), citv (inspection), sat_lima (vehicle tax)
  • CL: prt (inspection), autopase (toll debt), sii_tasacion (vehicle valuation)
  • EC: sri_vehiculos (vehicle tax/SPPAT), ant_multas (traffic fines)
  • MX: tenencia_edomex (vehicle tax), verificacion_cdmx (emissions), infracciones_cdmx (fines), fotocivicas (photo enforcement)

Government Data APIs (10 new)

  • US: census, bls, fred, fcc_broadband, osha
  • INTL: oecd, bis, idb, eclac, caf

Financial Regulators (8 new)

  • Banking supervisors: cl.cmf, cr.sugef, gt.sib, hn.cnbs, mx.cnbv, pr.ocif, bo.asfi
  • Securities: ar.cnv

Identity & Electoral (6 new)

  • pe.onpe, cl.servel, bo.segip, sv.rnpn, mx.sep (professional certification)

By Country (final count)

Country Sources Country Sources
CO 94 VE 13
BR 27 DO 12
US 26 BO 12
PE 21 SV 12
CL 20 CR 11
MX 20 GT 11
INTL 18 HN 11
AR 18 NI 11
EC 18 PY 11
PA 13 UY 11
PR 11

Install

pip install openquery==1.1.0

v1.0.0 — 300 Sources, 21 Countries

06 Apr 05:10

Choose a tag to compare

OpenQuery v1.0.0 🎉

300 public data sources across 21 countries and regions.

Highlights

Source Coverage

  • 300 total sources (up from 134 in v0.9.0)
  • 21 countries/regions: CO, US, BR, EC, PE, CL, MX, AR, PA, VE, BO, CR, DO, SV, GT, HN, NI, PY, UY, PR, INTL
  • 3 new countries: Venezuela (VE), Nicaragua (NI), Puerto Rico (PR)

By Country

Country Sources Country Sources
CO 91 CR 8
US 21 DO 8
BR 21 BO 8
EC 13 SV 8
PE 13 GT 7
CL 13 HN 7
INTL 13 NI 7
MX 12 PY 7
AR 11 UY 7
PA 10 PR 6
VE 9

New Source Categories

  • US Vehicle Sources: 13 state DMV lookups (FL, OH, NY, IL, GA, ID, AZ, CO, TN, LA) + NHTSA safety ratings, investigations, NICB stolen check
  • US Federal: SEC EDGAR filings, FDA recalls, SAM.gov debarment
  • International: World Bank, IMF, WHO, FATF, EU Sanctions, OpenCorporates, GLEIF LEI, WIPO trademarks, UN Comtrade, WTO
  • Latin America: Electoral registries, court cases, company registries, property registries, social security, tax lookups, vehicle registries, trademark offices, banking regulators

Infrastructure

  • Proxy support: OPENQUERY_PROXY_URL env var for residential proxy WAF bypass
  • captcha.py bug fix: TwoCaptchaSolver class header was missing
  • 17 sources un-deprecated: Changed from DEPRECATED to NEEDS_WORK (WAF/reCAPTCHA — fixable with bypass providers)

Quality

  • 2,694 tests, 0 failures
  • Lint clean: All ruff checks passing
  • CI ready: Tests + lint + Docker build

Install

pip install openquery
# or
uv add openquery

Quick Start

# Decode a US VIN
openquery query us.nhtsa_vin --vin 1HGBH41JXMN109186

# Check NHTSA safety ratings
openquery query us.nhtsa_safety_ratings --custom search -e '{"make":"toyota","model":"camry","year":"2024"}'

# Query World Bank GDP data
openquery query intl.worldbank --custom CO -e '{"indicator":"NY.GDP.MKTP.CD"}'

# List all 300 sources
openquery sources

v0.7.0 — City-Level Traffic Fines + reCAPTCHA v2 Providers

02 Apr 03:47

Choose a tag to compare

What's New

City-Level Traffic Fines (3 new sources)

Query traffic fines (multas/comparendos) directly from municipal transit offices — independent from the national SIMIT system.

Source City Inputs CAPTCHA
co.multas_bogota Bogotá Cédula, Placa Math (auto-solved)
co.multas_medellin Medellín Cédula, Placa None (reCAPTCHA v3 passes)
co.multas_itagui Itagüí Cédula None

Bogotá queries the WebFenix portal backed by Azure APIM REST endpoints. Returns comparendos with number, type, date, status, plate, balance, interest, and total.

Medellín queries the Movilidad en Línea SPA (Quipux/AngularJS) intercepting the /backavit/avit/home/findInfoHomePublic API. Returns comparendos, multas, and morosos with full detail.

Itagüí queries the QITS portal (Java/PrimeFaces) via DOM event dispatch. No CAPTCHA required.

reCAPTCHA v2 Solver Framework

Pluggable provider system for solving Google reCAPTCHA v2 via external services:

Provider Env Var Price/1000
CapSolver OPENQUERY_CAPSOLVER_API_KEY ~$1
CapMonster OPENQUERY_CAPMONSTER_API_KEY ~$0.80
Anti-Captcha OPENQUERY_ANTICAPTCHA_API_KEY ~$2
2Captcha OPENQUERY_TWO_CAPTCHA_API_KEY ~$3

Set any API key and sources with reCAPTCHA v2 will use it automatically via build_recaptcha_solver().

Helpers included:

  • extract_recaptcha_sitekey(page) — extract sitekey from page HTML
  • inject_recaptcha_token(page, token) — inject token + trigger callback
  • build_recaptcha_solver() — auto-configure from env vars

Stats

  • 105 sources across 8 countries (CO, EC, PE, CL, MX, AR, US, INTL)
  • Shared MultasTransitoLocalResult model for all city transit sources

v0.3.0 — 8 new vehicle & transport sources (13 total)

31 Mar 23:31

Choose a tag to compare

What's New: 8 Vehicle & Transport Sources

OpenQuery now has 13 Colombian data sources — the most comprehensive open-source toolkit for Colombian public data.

API-based (instant, no browser needed)

Source Description Data
co.pico_y_placa Driving restriction calculator Bogota (par/impar), Medellin, Cali + holidays
co.peajes Toll road tariffs All ANI tolls by vehicle category
co.combustible Fuel prices Gasoline/diesel by city and station
co.estaciones_ev EV charging stations Location, connector type, hours
co.siniestralidad Road crash hotspots Fatalities, z-scores by road segment
co.vehiculos National vehicle fleet Plate/brand lookup from 40M+ records

Browser-based

Source Description
co.fasecolda Vehicle reference prices (17K+ references, used for insurance)
co.recalls Vehicle safety recall campaigns (SIC)

Quick examples

# Is my plate restricted today?
openquery query co.pico_y_placa --placa ABC123

# Fuel prices in Bogota
openquery query co.combustible --custom fuel --extra '{"municipio": "BOGOTA"}'

# EV charging stations
openquery query co.estaciones_ev --custom ev --extra '{"ciudad": "Medellin"}'

# Vehicle fleet lookup
openquery query co.vehiculos --placa ABC123

Install

pip install openquery==0.3.0

Stats

  • 195 tests passing
  • 13 data sources (8 new)
  • 5 sources require zero browser automation

v0.2.0 — Multi-engine CAPTCHA, LLM fallbacks, audit evidence

31 Mar 22:43

Choose a tag to compare

What's New

Multi-Engine CAPTCHA Solving

  • PaddleOCR PP-OCRv5 — 100% accuracy at ~130ms (new primary engine)
  • EasyOCR — 85% accuracy, combines with Tesseract via character-level voting for 90%
  • Auto-detection — OpenQuery detects installed engines and builds the optimal solver chain automatically

Free LLM Fallbacks for Knowledge CAPTCHAs

  • Ollama — local CPU inference, zero Python deps, just install Ollama and ollama pull llama3.2:1b
  • HuggingFace — free-tier cloud inference with HF_TOKEN
  • Fallback chain: Ollama → HuggingFace → Anthropic → OpenAI

3 New Colombian Sources

  • co.procuraduria — disciplinary records (antecedentes disciplinarios)
  • co.policia — criminal background (antecedentes penales)
  • co.adres — health system enrollment (EPS, regime)

Audit & Evidence System

  • Screenshots at key stages, network traffic capture, PDF evidence reports
  • SHA-256 result hashing for integrity verification
  • CLI: --audit --audit-dir ./evidence
  • API: "audit": true in request body

Documentation

Install

pip install openquery==0.2.0

# Recommended: add PaddleOCR for 100% CAPTCHA accuracy
pip install "openquery[paddleocr]"

Stats

  • 144 tests passing (up from 29)
  • 6 CAPTCHA engines supported
  • 5 data sources
  • 4 LLM backends

v0.1.0 — Initial Release

31 Mar 06:56

Choose a tag to compare

OpenQuery v0.1.0

Query public data sources worldwide through a unified CLI and REST API.

Highlights

  • Plugin architecture — add new data sources by implementing a single class with @register
  • Browser automation — Playwright-based scraping for JavaScript-heavy government sites
  • CAPTCHA solving — local OCR (pytesseract) with optional paid service fallback
  • WAF bypass — browser-context API calls preserve session cookies
  • Caching — in-memory, Redis, or SQLite backends with configurable TTL
  • Rate limiting — per-source token-bucket to respect server limits
  • REST API — FastAPI with auto-generated OpenAPI docs
  • Docker ready — docker-compose with Redis for production

Built-in Sources

Source Country Description
co.simit 🇨🇴 Traffic fines and violations
co.runt 🇨🇴 National vehicle registry (SOAT, RTM, ownership)

Install

pip install openquery

Quick Start

openquery sources
openquery query co.simit --cedula 12345678
openquery query co.runt --placa ABC123
openquery serve

Full documentation: https://github.com/dacrypt/openquery#readme