Examples for data science learning

Run a job in Spark 2.x with HDInsight and submit the job through Livy

Financial Forecasting and its correlation with Human Sentiments using Distributed Computing on Spark Framework

Movie recommendation Engine using Spark MLlib & Scala

Ingest a CSV file and store it in Parquet format with SBT

Spark Streaming app that collects NY City taxi trips from Kafka queue, save raw data into HDFS/Parquet and generate OLAP Cubes within Cassandra. On the other hand, there is a benchmark to compare queries in HDFS vs OLAP Cubes

Spark1.6和spark2.2的示例，包含kafka,flume,structuredstreaming,jedis,elasticsearch,mysql,dataframe

file format specific benchmarks for Parquet, ORC, Avro, JSON, and Arrow

personal solutions to big data problem scenarios using scala

Server Log Analytics in Apache Scala / Spark

Spark Null I/O file format

In-Stream final project

Repo for various Apache Spark scripts, exercises, challenges....

Data analysis of AADHAR dataset using Apache Spark

HDF5 files in spark, MusicMillionData

Large-scale Geospatial Data Analysis using SparkSQL