Example end to end data engineering project.
-
Updated
Dec 8, 2022 - Python
Example end to end data engineering project.
Ready to run docker-compose configuration for ML Flow with Mysql and Minio S3
Code for "Efficient Data Processing in Spark" Course
Sample project to demonstrate data engineering best practices
Minio Backend for Django
Unified cloud storage API for storage services.
Asynchronous MinIO Client SDK for Python
Nyc_Taxi_Data_Pipeline - DE Project
A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
Set up CI in DL/ cuda/ cudnn/ TensorRT/ onnx2trt/ onnxruntime/ onnxsim/ Pytorch/ Triton-Inference-Server/ Bazel/ Tesseract/ PaddleOCR/ NVIDIA-docker/ minIO/ Supervisord on AGX or PC from scratch.
Ansible role for installing and configuring Minio
A proof-of-concept FastAPI-based service for sending emails via SMTP. Supports plain text and HTML emails, with or without attachments. Includes validation, error handling and Swagger UI documentation. Ideal for educational purposes and demonstrations.
Full stack data engineering tools and infrastructure set-up
Pyminio is a python client wrapped like the os module to control minio server
Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
Maternal Health Risk prediction MLOps pipeline
Add a description, image, and links to the minio topic page so that developers can more easily learn about it.
To associate your repository with the minio topic, visit your repo's landing page and select "manage topics."