Showcase: ATS Zero-Browser Gateway — Fast protocol scraper & delta data feeder for vector search #11179
ginugokz
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Hi Qdrant community! 👋
When building vector search engines, recruitment AI apps, or semantic job search with Qdrant, ingesting live job postings from corporate career boards (Workday, Greenhouse, Lever, Ashby) usually involves heavy headless browser scraping and redundant document updates.
To optimize this ingestion pipeline, I built ATS Zero-Browser Gateway:
Protocol-Level Ingestion: Direct connection to backend JSON/CXS endpoints without launching a browser (~43MB RAM in ~8.9s per run).
Dual-Hash Delta Tracking: Automatically calculates structural & content hashes to tag postings as
ADDED,REMOVED, orUPDATED. Only new or modified jobs need embedding and upserting into Qdrant collections!MCP Native: Run as a standard Model Context Protocol (MCP) tool for AI agents querying corporate talent pipelines.
Apify Actor: Also runnable serverless on the Apify Store.
💻 GitHub Repo: https://github.com/ginugokz/ats-zero-browser-gateway
📦 Apify Store: https://apify.com/ginugokz/ats-zero-browser-gateway
Hope this serves as a useful data feeder for Qdrant semantic search projects!
Edited 17 Oct 2026: SmartRecruiters support was removed because its robots.txt disallows automated access. Supported: Workday, Greenhouse, Lever and Ashby.
All reactions