Twitter-Data-Analysis

These instructions will get you a copy of the project up and running on your local machine for development and testing purposes.

Prerequisites (Linux)

• Python

sudo add-apt-repository ppa:jonathonf/python-3.7
sudo apt-get update
sudo apt-get install python3.7

• pip3

sudo apt update
sudo apt install python3-pip

Installing

For Development

1. Clone the Repo

    git clone https://github.com/nebasam/Twitter-Data-Analysis.git

2. cd into repo

   cd Twitter-Data-Analysis

3. Install Requirements

    pip3 install requirements.txt

4. Extract dataframe

   python3 extract_dataframe.py

5. Clean Extracted DataFrame

   python3 clean_tweets_dataframe

6. Add Dataframe data into sql database #pls add your databasename, db password, db username to db.yaml file first

   python3 data.py

7. Run the App

    streamlit run main.py
   
   

Topic Modeling

Topic Modeling for twtter data can be found in twitter_modeling.ipynb jupyter notebook file.

Unit Testing

The following code enables you ti run unit test

1. Get into Test Directory

   cd tests

1. Run Test

   python3 test_extract_dataframe.py