The goal of this project is to extract data from the PhonePe Pulse GitHub repository, process it to obtain insights, and visualize it in a user-friendly manner. The solution involves extracting data, transforming it, inserting it into a MySQL database, and creating an interactive geo visualization dashboard using Streamlit and Plotly in Python.
- Data Extraction: Clone the PhonePe Pulse GitHub repository to fetch the data.
- Data Transformation: Clean and preprocess the data using Python and Pandas.
- Database Insertion: Connect to a MySQL database and insert the transformed data.
- Dashboard Creation: Create an interactive and visually appealing dashboard using Streamlit and Plotly.
- Data Retrieval: Fetch data from the MySQL database to update the dashboard dynamically.
- Dropdown Options: Provide at least 10 dropdown options for users to select different facts and figures on the dashboard.
- Data Extraction: Clone the GitHub repository and store the data in a suitable format (CSV or JSON).
- Data Transformation: Use Python and Pandas to clean, preprocess, and transform the data.
- Database Insertion: Connect to MySQL using "mysql-connector-python" and insert data using SQL commands.
- Dashboard Creation: Utilize Streamlit and Plotly in Python to create an interactive dashboard with geo visualizations.
- Data Retrieval: Connect to the MySQL database and fetch data into a Pandas dataframe for dynamic dashboard updates.
- Deployment: Ensure the solution is secure, efficient, and user-friendly. Test thoroughly and deploy the dashboard publicly.
- Streamlit app
- Use dropdown options to select different facts and figures on the dashboard.
- Python: For scripting and data manipulation.
- Pandas: For data cleaning and preprocessing.
- MySQL: For efficient storage and retrieval of data.
- Streamlit: For building the user interface.
- Plotly: For creating interactive visualizations.