9moja

Versions

• python-3
• django-1.11

Database for first-time:

go to project directory/processors/ , run create_db.sh

cron test:

go to project directory/processors/ , run start_cron.sh

Options:

• core/settings.py
  • FB_PAGE_SCRAP_FOR_CRON for cron job facebook scrapping
    • Add page id (from facebook url) / if username set up in page, it can also be used
    • Set a unique name for this page. It'll be used as a category
  • SOCIAL_AUTH_FACEBOOK_KEY and SOCIAL_AUTH_FACEBOOK_SECRET
    • facebook app id and secret id
  • SOCIAL_AUTH_TWITTER_KEY and SOCIAL_AUTH_TWITTER_SECRET
    • twitter app id and secret id
• processors/cron.py
  • DATA_MINING_PAGE_DEPTH
    • facebook scrapping can be done for 100 data each time. This value will be set for how many pages data will be scrapped
  • TOP_POST_NUMBER
    • facebook top post (according to share and like) number

setup cron job task

• chmod 755 <project_directory>/processors/start_cron.sh
• open terminal and type crontab -e
• add this line at the very bottom 0 */8 * * * <project_directory>/processors/start_cron.sh (this will run every 8 hours)
• for help, visit: crontab guru