Skip to content
a crawler of job opportunities
XSLT JavaScript Python CSS
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
jobful
solr
tests
.gitignore
README.md
requirements.txt
scrapy.cfg

README.md

Jobful

a crawler of job opportunities. How to run:

Requirements:

  • mongo and Solr

Features:

  1. Crawl job positions:
  • scrapy crawl # ex. scrapy crawl wm-jobs
  1. Start Solr:
  • solr <absolut path to jobful/jobful/solr>
  1. Index job positions:
  • python solr_indexer.py
You can’t perform that action at this time.