Using the Thunder Library for Image Processing with Spark ML Lib

对Spark ML进行二次封装，提供api调用

Big data technologies that I have experimented with

Simple Content based and Collaborative Filtering Algorithms implementaion

Yelp Toronto User Pattern Analysis and Recommender System

A Spark Streaming implementation for Online Twitter Sentiment Analysis.

Apache Spark is one of the most widely used and supported open-source tools for machine learning and big data. In this repo, discover how to work with this powerful platform for machine learning. This repo discusses MLlib—the Spark machine learning library—which provides tools for data scientists and analysts who would rather find solutions to b…

Sentiment Analysis and Data Visualization

Ads data process with Spark's MLLib

A UDF to evaluate Spark-MLlib classification model using PySpark

Efficiently tackle large datasets and perform big data analysis with Spark and Python

Apache Spark is a fast and general-purpose cluster computing system. It provides high-level APIs in Java, Scala, Python and R, and an optimized engine that supports general execution graphs. It also supports a rich set of higher-level tools including Spark SQL for SQL and structured data processing, MLlib for machine learning, GraphX for graph p…

A movie recommender system using user-based collaborative filtering algorithm.

This repo contains code for restuarant recommendation system for users based upon business rating value.

IPL Match Simulation using K-means Clustering and Collaborative Filtering.

Implementation to coursera machine learning course, some tensor flow code.

A movie recommendation system built using Apache Spark’s ML library

Application of Sentiment Analysis of Italian tweet with Python and Spark

In this project I stream data and do crime classification using Spark. This dataset contains incidents derived from the SFPD Crime Incident Reporting system. The data ranges from 1/1/2003 to 5/13/2015. I do some data analysis of crime scenes in different areas and with respect to other parameters.