Real-time Cryptocurrency Price Prediction and Analysis Platform

Final Project for CMPT733 - Programming for Big Data II

MSc. in Computer Science, Big Data

Simon Fraser University

Key Components

EDA/Feature Generation Test
- Coin_EDA.ipynb Various Exploratory Data Analysis on cryptocurrency price, volume and sentiment data
- FGI_CryptoCompare_data.ipynb Tried to integrate FGI API for sentiment score
- Feature_Explore_Test.ipynb Conducted time series analysis for cryptocurrency price data
Model Development:
- model_test.ipynb
- Built a LSTM model for price prediction
Real-Time Pipeline:
- realtime_pipeline.py
- Fetch data through API in real time and return prediction results
Streaming
- connection_test folder
- RabbitMQ as streaming message broker that is deployed on AWS
- RabbitMQ forward prediction results to our back-end NodeJS server
Web Application
- React-Frontend folder

1.Installation

# clone repo
git clone https://github.com/ycxmichael/CMPT733_CryptoCurrency_Project.git
cd CMPT733_CryptoCurrency_Project

2.Download all_news.csv

download through this link

this is our pre-fetched data for all news content from 2017-01-01 to present

please download this file if you want to retrain the model and go through the model_test.ipynb

3.Run realtime_pipeline.py to get realtime prediction results

in terminal, run python realtime_pipeline.py

4.Web Application

cd React-Frontend/src

then in terminal, run node server.js to start the backend server

To start the react frontend, cd React-Frontend, run npm start

Name		Name	Last commit message	Last commit date
Latest commit History 38 Commits
.idea		.idea
.ipynb_checkpoints		.ipynb_checkpoints
React-Frontend		React-Frontend
connection_test		connection_test
Coin_EDA.ipynb		Coin_EDA.ipynb
FGI_CryptoCompare_data.ipynb		FGI_CryptoCompare_data.ipynb
Feature_Explore_Test.ipynb		Feature_Explore_Test.ipynb
Market_Analysis.ipynb		Market_Analysis.ipynb
README.md		README.md
Real-Time Pipeline.ipynb		Real-Time Pipeline.ipynb
VTI.csv		VTI.csv
coin_complete.csv		coin_complete.csv
coin_complete_time.csv		coin_complete_time.csv
coin_model_1.h5		coin_model_1.h5
coin_price_time.csv		coin_price_time.csv
cryptocompare_api_utils.ipynb		cryptocompare_api_utils.ipynb
kaggle_test.ipynb		kaggle_test.ipynb
model_test.ipynb		model_test.ipynb
news_PN_sentiment.csv		news_PN_sentiment.csv
realtime_pipeline.py		realtime_pipeline.py