This is a simple Blockchain demo

Simple examples to familiarize myself with Spark

Mirror of Apache Storm

Proyecto Hadoop MapReduce de algoritmos de detección de tendencias sobre series temporales, aplicados a datos de ventas de productos relacionados con control de plagas (repelentes e insecticidas).

AWS Cloudera Hadoop setup with H2O, Spark, MR

Java code to download the files and uploading them to HDFS. With decompression of files on the HDFS

High Performance Kafka Consumer for Spark Streaming. Compatible with every Spark and Kafka versions including latest Spark 2.2.0 and Kafka 0.11.0. Now supports Kafka Security. Offset management in Zookeeper. Reliable No-Dataloss gurantee. No dependency on HDFS or Checkpointing and WAL. In-built PID rate controller. Support Message Interceptor . …

Repo with a few Hadoop exercises

Data Processing applications!

Managing complex concepts that form the Big Data stack to the scale and speed required by Big Data datasets using Bash, SQL/NoSQL, Hadoop, Spark and GraphX.

Data analysis of police call center records with Apache Spark and writing to Mongodb

In this project i have implemented the hadoop pipeline using sqoop for ingestion,hive for sumaarising and implementing the warehosue logics and MYSQL as an DB for validationa and storage.The entire thing was automated using the script and with help of bash commands we made it each and every incident is logged properly

Lab 2 in Introduction to Big Data Course

This repository includes a brief but informative and simple explanation of Apache Spark and Spark SQL terms with java implementation.

Topic modeling with my algorithm ADS-LDA using Gibbs sampling in Scala and Apache Spark

(Class) Big Data Analysis Course Assignments

Group project carried out during the 'Big Data' course at the University of Padua with Professor Andrea Alberto Pietracaprina. The project consists of three assignments that require the use of Apache Spark in Java.