JobScout is a high-performance, full-stack Job Discovery & Tracking Platform designed to automate your job search. It monitors company career pages, scrapes new openings, and uses an intelligent matching engine to help you find the roles that matter most.
Monitor career pages from top tech companies. Support for specialized ATS platforms including:
- Greenhouse
- Lever
- Ashby
- Custom Web Scrapers
Define your target keywords (React, TypeScript, Senior, etc.) and let JobScout calculate a Match Score for every discovered role. Focus your energy on the highest-relevance opportunities.
Monitor background workers and scrape health directly from the System Status dashboard. Track success rates, discovery counts, and scrape durations.
Get global success/error feedback via a premium glassmorphic toast system and configure email digests for daily summaries of new matching roles.
- Frontend: Next.js 14 (App Router), Tailwind CSS, Framer Motion, Lucide Icons.
- Backend: Next.js API Routes, BullMQ (Queue Management).
- Database: PostgreSQL (Data persistence), Redis (Queue Broker & Caching).
- ORM: Prisma.
- Auth: JWT-based secure session management.
- Node.js 18+
- Docker & Docker Compose
-
Clone the repository:
git clone https://github.com/o1-spec/Web-scraper.git cd Web-scraper -
Environment Setup: Copy the example environment file and fill in your secrets.
cp frontend/.env.example frontend/.env
-
Start Services (Docker):
docker-compose up -d
-
Install Dependencies & Sync Database:
cd frontend npm install npx prisma migrate dev -
Run the Application:
# Terminal 1: Web App npm run dev # Terminal 2: Background Workers npx ts-node worker.ts
For a deep dive into the system design, pipeline flow, and database schema, see our ARCHITECTURE.md.
Distributed under the MIT License. See LICENSE for more information.
Built with passion for the developer community.