Data Science Big Data Tools

This repository Contains notebooks for Data Science & Big Data tools exploring.

Details

• Exploratory-Data-Analysis: Exploratory data analysis (EDA) for Customer traffic prediction dataset.
  
  
• Processing-Time: How does processing time vary by data size.
  
  
• Data-Preprocessing-Arabic-Text: Some data pre-processing methods on Arabic text.
  
  
• Image-Preprocessing: Some data pre-processing methods and techniques on a skin cancer dataset.
  
  
• Kmeans: Kmeans Clustring Algorithm practice.
  
  
• Decision-Tree: Decision Tree Algorithm practice.
  
  
• Hadoop: Overview of Hadoop Storage and processing components.
  
  
• Hive: Get an overview about Hive and Learn how to use Hive to create tables and perform queries against them.
  
  
• Spark-01: Intro to Spark, Spark RDD and Spark SQL.
  
  
• Spark-02: Apply user defined functions (UDF) on Your Dataframe Columns and kmeans using pyspark SQL & pyspark MLlib