Example end to end data engineering project.
-
Updated
Dec 8, 2022 - Python
Example end to end data engineering project.
Ready to run docker-compose configuration for ML Flow with Mysql and Minio S3
Code for "Efficient Data Processing in Spark" Course
Sample project to demonstrate data engineering best practices
Minio Backend for Django
Unified cloud storage API for storage services.
Asynchronous MinIO Client SDK for Python
Nyc_Taxi_Data_Pipeline - DE Project
A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
Set up CI in DL/ cuda/ cudnn/ TensorRT/ onnx2trt/ onnxruntime/ onnxsim/ Pytorch/ Triton-Inference-Server/ Bazel/ Tesseract/ PaddleOCR/ NVIDIA-docker/ minIO/ Supervisord on AGX or PC from scratch.
Ansible role for installing and configuring Minio
Full stack data engineering tools and infrastructure set-up
Pyminio is a python client wrapped like the os module to control minio server
Creation of a data lakehouse and an ELT pipeline to enable the efficient analysis and use of data
Maternal Health Risk prediction MLOps pipeline
A minimalistic and pluggable machine learning platform for Kubernetes.
Add a description, image, and links to the minio topic page so that developers can more easily learn about it.
To associate your repository with the minio topic, visit your repo's landing page and select "manage topics."