Contains information and instructions for the first Data Mining lab session for 2017 Fall.
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
helpers
.gitignore
Data Mining Lab 1 - 2017.pdf
README.md
news_data_mining.ipynb

README.md

Lab For Data Mining 2017 Fall @ NTHU

This repository contains all the instructions and necessary code for Data Mining 2017 (Fall) lab session.


Computing Resources

  • Operating system: Preferably Linux or MacOS
  • RAM: 8GB
  • Disk space: Minimum 8GB

Software Requirements

Here is a list of the required programs and libraries necessary for this lab session:

  • Python 3+ (Note: coding will be done strictly on Python 3)
    • Install latest version of Python 3
  • Anaconda environemnt or any other environement (recommended but not required)
    • Install anaconda environment
  • Jupyter (Strongly recommended but not required)
    • Install jupyter
  • Scikit Learn
    • Install sklearn latest python library
  • Pandas
    • Install pandas python library
  • Numpy
    • Install numpy python library
  • Matplotlib
    • Install maplotlib for python
  • Plotly
    • Install and signup for plotly
  • NLTK
    • Install nltk library
  • WordCloud
    • Install library for generating word clouds

Test script

Open a Jupyter notebook and run the following commands. If you have properly installed all the necessary libraries you should see no error.

import pandas as pd
import numpy as np
import nltk
from sklearn.datasets import fetch_20newsgroups
from sklearn.feature_extraction.text import CountVectorizer
import plotly.plotly as py
import plotly.graph_objs as go
import math
%matplotlib inline
from wordcloud import WordCloud
# my functions
import helpers.data_mining_helpers as dmh
import helpers.text_analysis as ta

Preview of Complete Jupyter Notebook

https://github.com/omarsar/data_mining_2017_fall_lab/blob/master/news_data_mining.ipynb