The project is named training.
Python 3.8.10
psql (PostgreSQL) 15.2
Сontains the following tasks:
- Task 1. Python introduction
- Task 2. Pandas/NumPy
- Task 3. SQL queries
- Task 4. Spark Demo Course
- Task 5. Spark framework Course
- Task 6. Airflow Demo Course
- Task 7. Airflow introduction
- Task 8. Snowflake
- Task 9. Alert project
The following requirements must be met in order to run the project:
- Python 3.x version.
- The dependencies from requirements.txt must be installed.
- A local PostgreSQL database must be created.
- A .env folder must be created with the following values:
DATABASE_HOST=your_lhost
DATABASE_NAME=your_database_name
DATABASE_USER=your_user
DATABASE_PASSWORD=your_password
To install the dependencies, run the following command:
pip install -r requirements.txt