HOW TO USE:
-
download repository to your local machine
-
open terminal and go to your copy of the repository: "path/Djinni_profiles_scrap"
-
setup necessary lib just running command pip install -r requirements.txt
-
to start collecting data open statr.py in your editor and change in line (6) pageUrl = 'https://djinni.co/developers/?title=*********' + '&page=' start url for yours needs; save file, close
-
in termanal window type: "path/Djinni_profiles_scrap> python start.py"
-
collecting data saved to "profile.txt" file (utf-8)
-
start JupyterNoteBook and open "look_at_data.ipynb" file to start explore data
TO DO
- check to correct scrap non-int experience year
- check formating of text
- check for speed up