Skip to content
This repository has been archived by the owner on Oct 5, 2020. It is now read-only.

zazazack/jobs

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

57 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

jobs

Work smart not hard.

Scrapy spider for searching for jobs. Currently only for Houston, TX.

Installation

Development version

$ git clone https://github.com/zazazack/jobs.git

Release version

$ docker pull zwilson/jobs

Usage

Crawls popular job posting sites (currently only indeed.com) to collect post data

To run locally w/ scrapy (via docker)

$ docker run --rm -v items:/usr/src/items zwilson/jobs scrapy crawl $SPIDER

To deploy add a version to a scrapyd server

$ docker-compose up # NOTE: must be on the same network as scrapyd server

About

Work smart not hard

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published