This project consists of a Kibana dashboard for Bitcoin price visualization and price prediction using YahooFinance API. The project sets up a complete pipeline for data collection, streaming, indexing, visualization and ML model training and prediction.
Project Architecture Data Visualization Data Visualization Anomaly detection tool in Kibana to detect unusual patterns Forecast the bitcoin price using Forecast tool in Kibana for the next 14 days Predicted value visualization Price prediction for the next week using LSTM
.
├── Data
├── img
├── notebooks
│ ├── Bitcoin_price_prediction_LSTM.ipynb #Machine learning mode
| ├── Messari API
| ├── producer1.py
| ├── consumer1.py
| ├── YahooFinance API
| ├── producer2.py
| ├── consumer2.py
| ├── requirements.txt
├── docs #Report
└── README.md
This work relies on Historical bitcoin data from YahooFinance. This dataset includes all historical bitcoin price from 17 September 2014 until today.
- Elasticsearch 7.17.5
- Kibana 7.17.5
- Kafka 3.2.0
- Spark 3.3.1
- To install python packages run
pip install -r requirements.txt
To document our work, we wrote repoart that is included in the repo.