Spark Bulk Data Load. This is a data engineering project. Ingest the data from Hive tables present in the Master Data Management Platform and do the all processing in spark.
-
Updated
Sep 26, 2023 - Python
Spark Bulk Data Load. This is a data engineering project. Ingest the data from Hive tables present in the Master Data Management Platform and do the all processing in spark.
Add a description, image, and links to the hive-table topic page so that developers can more easily learn about it.
To associate your repository with the hive-table topic, visit your repo's landing page and select "manage topics."