NPS Popularity Monitoring & Analysis

Group D1/2022-23

Description: The project provides set of function to run the dashboard for analyzing the popularity of NPS

Explanation video: https://youtu.be/vtTDSOf4pHo

Teaser video: https://youtu.be/zbyykZzyDMk

CONTENT:

Data Sets

In order to use the dahsboard the inital dataset should be first downloaded from the
https://drive.google.com/file/d/1gCj0Ryc9wiOV1TBZyrJDHAIe8f3Lpejl/view?usp=sharing and saved into ./final_dashboard_D1

requirements

the version of pandas supported is 1.4.2

directory and file structure

├── code                  - scrapers and different tools
│   ├── analysis
│   │   ├── timeseries
│   │   └── timeseries_info
│   └── scrapers
│       ├── drugsforum
│       ├── reddit
│       ├── telegram
│       └── vendors
├── corpus                 - output from drug forums
│   ├── forums
│   │   ├── drugsforumInfo
│   │   │   ├── comments
│   │   │   └── threads
│   │   └── drugsforumNL
│   │       ├── comments
│   │       └── threads
│   └── trimbos
└── final_dashboard_D1
    ├── assets
    └── nl_corpus

In order to run the dashboard, run the following command, loading time is about 20 min

1. cd final_dashboard_D1
2. python dashboard.py

In order to update data sets run the following:
reddit update : run jupyter notebook code/scrapers/reddit/reddit-scraper.ipynb
list of nps update : python code/scrapers/vendors/combine_csv.ipynb
drugsforum.nl update : cd final_dashboard_D1/nl_corpus | python drugsforum-nl.py