Take a look at updated version: https://github.com/grzesiekdev/indeed_scraper
This program is designed to scrap job offers from https://pl.indeed.com/. Scraped offers go to output.html, and are nicely represented in form of bootstrap table.
git clone https://github.com/Regorg/indeed_scraper.git
- Python >=3.7
- requirements.txt
cd indeed_scraper
pip install -r requirements.txt
python main.py
Enter job name: <job name that you are looking for>
Enter place: <location>
Enter radius: <maximum distance from location>
Then after a while, you can check output.html in /indeed_scraper/
Fill < > parameters with specific data
scraper = Scraper(<job_name>, <location>, <radius>)
template = Template(scraper.offers, scraper.number_of_offers)
You can find and run tests in /scraper/tests, by:
python test_scraper.py
Class ScraperLocal in /scraper/tests/scraper_local.py is designed to run tests on static version of indeed page, because some elements were hard to check on live version of site, due to constant changes.