Your personal job finder bundled in a single container
- Scrape for links
ahref
class - Scrape linkedin, Dice, Monster
- included links I use for Automation in AWS and crons locally
-
emailcsv.py
- emailfrom
- emailto
- fileToSend
- username
- password
- serverg
- port
-
jobDetective.py
- joblink
Install is simple! After you fill in needed variables, you can either:
Docker build
the dockerfile and run the container, or just use thelocalContainerBuild.sh
and change the name of the image- Or just run it locally if you have the dependices already installed (I am lazy yes, I will be adding the requirements.txt)
- If running locally, move
macdriver
or which ever you need tousr/local/bin
or wherever$PATH
can be called - Add these libraries for scraping:
- python3 -m pip install wheel pandas BeautifulSoup4 awscli
- awscli
- selenium
- pandas
- bs4 (beautifulsoup)
- python3 -m pip install wheel pandas BeautifulSoup4 awscli
- Chrome Drivers Drivers
- Errors for pandas panda
- Install Chromium ubuntu Install
- Get Chrome driver for Unbuntu linuxdriver
- Selenium driver crash error
- linux driver chrome repo REPO
- Find href links - If you wanna try! links!
- google captcha for container captcha ^ Good for if you are having permissions issues with chrome
- Genereate app PW app
Feel free to email and let me know what you think of this! Its still in baby stages and I stripped a good portion down for security reasons but first "big" open source project! Lay it on me, all criticism welcomed!
Email: terryyoung1192@gmail.com