#

data-lake

Here are 7 public repositories matching this topic...

lakeFS

treeverse / lakeFS

lakeFS - Data version control for your data lake | Git for data

go golang apache-spark aws-s3 google-cloud-storage data-engineering data-lake azure-storage data-version-control object-storage datalake hadoop-filesystem data-quality data-versioning azure-blob-storage apache-sparksql git-for-data lakefs datalakes

Updated Oct 11, 2024
Go

GitDataAI / jzfs

A Git-like version control file system for data lineage & data collaboration.

data-lake dataops data-version-control datalake data-product data-versioning aiops data-lineage federated-learning mlops data-mesh git-for-data digital-twins data-collaboration enterprise-datahub data-lake-management git-filesystem version-controlled-filesystem jiaozifs

Updated Sep 27, 2024
Go

realtimedatalake / rtdl

rtdl makes it easy to build and maintain a real-time data lake

Updated Oct 12, 2022
Go

cnfuzz

suecodelabs / cnfuzz

Breaking Cloud Native Web APIs in their natural habitat.

microsoft kubernetes golang aws opensource rest-api aws-s3 openapi data-lake fuzzing cloud-native openapi-spec cicd service-mesh restler security-tools rest-api-test

Updated Apr 24, 2023
Go

nkmr-jp / gcf-fetch

Cloud Functions that fetch data from public APIs and store it in Google Cloud Storage. Runtime: Go 1.20. Gen: 2nd gen.

golang data-science gcp google-cloud data-lake google-cloud-platform cloudevent

Updated Jul 20, 2023
Go

sskender / cloud-data-engineering-technologies

Cloud Data Engineering Technologies FER labs

docker kubernetes azure kubernetes-cluster data-lake azure-functions azure-keyvault kubernetes-deployment azure-kubernetes-service azure-devops azure-pipelines azure-vault

Updated Jul 12, 2024
Go

dataphos / persistor

Persistor is a product used for permanent data storage. It provides support for multiple cloud platforms, more specifically the Google Cloud Platform and Microsoft Azure, as well as for various broker types (GCP PubSub, Azure Service Bus and Kafka) and different kinds of storage services (Google Cloud Storage and Azure Blob Storage).

go kafka serverless azure messaging data-stream gcp data-lake event-driven cloud-native data-streaming data-mesh

Updated Oct 11, 2024
Go

Improve this page

Add a description, image, and links to the data-lake topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the data-lake topic, visit your repo's landing page and select "manage topics."