Distributed processing of Wikipedia history files using Hadoop and Spark
-
Updated
Jan 6, 2019 - Scala
#
hadoop-hdfs
Here are 10 public repositories matching this topic...
A collection of useful scala scripts to work with Hadoop
-
Updated
Sep 5, 2020 - Scala
In this project, we are going to build a Bicycle sharing demand prediction service using Apache Spark and Scala. I have created a two spark application one for model generation and another for model demand prediction.
machine-learning
scala
spark
hadoop
spark-streaming
spark-sql
spark-mllib
databricks-notebooks
hadoop-hdfs
-
Updated
Jan 8, 2021 - Scala
An Automated ETL Data pipeline which extract complex json data from web API service (GBFS-bixi Data) and convert to CSV for loading into Data-warehouse HDFS. After-that, Hive will process the further by external and managed table. Same procedure is also applied with AWS S3 and Athena.
-
Updated
Nov 23, 2021 - Scala
Batch ETL data pipeline built on HDP 3.0 to process daily sales and business data to procedure power Bi reports. Automated the pipelines using Airflow.
-
Updated
Dec 29, 2021 - Scala
DFS-Lib is a scala flavoured api to the Hadoop java filesystem api
-
Updated
Apr 30, 2022 - Scala
-
Updated
May 11, 2023 - Scala
Distributed computational problem-solving project, which aims to perform large-scale graph matching using cloud computing technologies. The project allows users to import two directed graphs and analyze the differences between them.
-
Updated
Oct 25, 2023 - Scala
Average Temperature - Hadoop - Mapper - Reducer
java
scala
big-data
cassandra
hadoop
bigdata
cassandra-cql
hadoop-filesystem
hadoop-mapreduce
hadoop-hdfs
-
Updated
Mar 26, 2024 - Scala
Improve this page
Add a description, image, and links to the hadoop-hdfs topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the hadoop-hdfs topic, visit your repo's landing page and select "manage topics."