This repository contains all the web mining assignments for the CSE3024 lab as of Fall'18.
24th July 2018 Exercise 1
- Write a program to tokenize
- A sentence
- Multiple sentences
- Write a program to count the frequency of tokenized words from two sentences.
- Write a program (using nltk toolkit in python environment) to tokenize
- Sentence
- Multiple sentences
- A paragraph
- Information of a complete web page
- Write a program to remove the stop words stemming using nltk tool?
31st July 2018 Exercise 2
- Write a program to do stop word removal and stemming from a paragraph.
- Prepare a table that includes “Word” and “frequency (2 columns).
- Print the frequency of words (terms) start with A,B,S,D,E.
- Find maximum frequency terms/term.
21st August 2018 Exercise 3
- Implement single Topical Crawler(My Spider)
- Then multiple crawlers Myspider1 first and then run the Myspider2 multiples times depending (sequentially) on some conditions.
4th September 2018 Exercise 4
- Coding Techniques
- TF-IDF
11th September 2018 Exercise 5
Estimate the page rank for the given directed graph representing web of six pages and damping factor is 0.9 and Max. Iterations are 2.
- First find adjacency matrix
- Find stochastic matrix
- Find transpose
- Calculate page rank
18th September 2018 Exercise 6
- TF-IDF
- Cosine Similarity
- Page Rank
- Goloumb Coding
10th October 2018 Exercise 7
- Naive Bayes
- Dataset
- Find accuracy, AUC and confusion matrix
- Multinomial Naive Bayes
- Apriori
- K-means
16th October 2018 Exercise 8
- Construction of a directed graph and undirected graph with nodes(plot function)
- Colour the edges and nodes(plot)
- Name the nodes
- Print adjacency matrix of undirected graph
- Add few extra nodes to the network and name them as well
- Print diameter of the graph
- Find degree of all nodes
- Find in-degrees of all nodes and out degrees of all nodes
- Find density of any nodes
- Find closeness centrality of all nodes
- Create network from a given data set. You can choose any one of the data sets from the following link
- Prepare a histogram of ‘Frequency' vs 'Degree of Vertices'
- Convolution Neural Network (CNN) for Image Recognition
- Convolution Neural Network (CNN) for Optical Character Recognition (OCR)
Deep Neural Network for predicting housing prices
- Jacob John - Initial work - jacobjohn2016