DataMastersRepo

Welcome to the DataMastersRepo! This repository contains various Jupyter Notebooks and JSON files related to data ingestion and processing. Below you will find a brief description of each file and its purpose.

Files and Description

• Lambda - DataFetching.ipynb: Jupyter Notebook for fetching data using AWS Lambda functions.
• Lambda - DataLoading.ipynb: Jupyter Notebook for loading data into databases using AWS Lambda functions.
• Manual_coding.ipynb: Jupyter Notebook for manually coding and processing data.
• club_cities.json: JSON file containing data about various club cities.
• dailyIngest.ipynb: Jupyter Notebook for daily data ingestion processes.
• historic_weather.json: JSON file containing historical weather data.
• hourlyIngest.ipynb: Jupyter Notebook for hourly data ingestion processes.
• weeklyIngest.ipynb: Jupyter Notebook for weekly data ingestion processes.

How to Use

1. Clone the Repository:

   git clone https://github.com/amirkadriju/DataMastersRepo.git

2. Navigate to the Directory:

   cd DataMastersRepo

3. Open Jupyter Notebooks: Use your preferred method to open Jupyter Notebooks. For example, you can use Jupyter Lab or Jupyter Notebook.

   jupyter lab
   # or
   jupyter notebook

4. Explore the Notebooks:

   • Open any of the Jupyter Notebooks to explore the data fetching, loading, and processing code.
   • Modify the JSON files as needed to include your own data or test with different datasets.