Skip to content

bdp-yk/tempscrap

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

requirements

  • MongoDB
  • Python [latest versions are good]

installation

  • create new environment in this folder
python -m venv [virtual_environment_name]
  • activate environment in this folder
.\[virtual_environment_name]\Scripts\activate
  • install all dependecies
pip install -r requirements.txt
  • set the flask properties
$env:FLASK_APP = "app.py" // this is optional
$env:FLASK_ENV = "development" // this is required
  • run the application
flask run

todo

  • put your scrappers/crawlers under the scrappers folder
  • in the scrappers_init_ follow the same instructions
  • in the /app.py
    • modify connexion string
    • update the function under the # MODIFY THIS ! comment

About

template for scrapping

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published