UNLV_Procject

• In University of Nevada, Las Vegas
• Period: 2023.06.25 ~ 2023.07.23
• Project: Definition of scaleable machine learning for big data
• Description: Big data analytics provides scalable solutions for distributed or very large data. For this project, students will have hands-on experience installing Apache Spark, and practicing python libraries, e.g., MLLib, while applying supervised and unsupervised machine learning algorithms to large datasets for data analysis and developing machine learning models.

Project subject

how to implement map and reduce function using Spark

Weekly Plan

• Week 1: Intro Machine Learning
• Week 2: Semina about Spark[slide]

Papers

• Spark: Cluster Computing with Working Sets
• PySpark : High-performance data processing without learning Scala
• MLlib: Machine Learning in Apache Spark
• Scalable Machine Learning Using PySpark
• A MapReduce based distributed SVM algorithm for binary classification