One short text dataset for classification and clustering extracted from StackOverflow
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
benchmarks
matlab_format
rawText
README.md

README.md

Short text dataset for classification and clustering extracted from StackOverflow

Note that:

  1. If you use this short text dataset, please cite our paper:
    [1]. 2015NAACL VSM-NLP workshop-"Short Text Clustering via Convolutional Neural Networks"
    and acknowledge Kaggle for making the datasets available.
  2. We do not remove any stop words or symbols in the text;
  3. If you run the Classification ACC.m, please run it on 64-bit machine;
  4. Classification is fast, while Clustering is very slow via KMeans on so high-dimensionality text features, about 2 hours once. If you want to run clustering via KMeans, please have a little patience, and we strongly suggest that you directly refer the KMeans results in our paper [1] which reports the average results by running KMeans 500 times;
  5. The demo code can be found at https://github.com/jacoxu/STC2
  6. Please feel free to send me emails (jacoxu@msn.com) if you have any problems in using this package.

./rawText: Raw text, 20,000 titles as short texts
  -- label_StackOverflow.txt: Each title plus a tag/label at the end;
  -- title_StackOverflow.txt: Each title on each line;
  -- vocab_emb_Word2vec_48.vec: Word2vec trained from a large corpus of StackOverflow dataset;
  -- vocab_emb_Word2vec_48_index.dic: Word2vec index list corresponds with vocab_withIdx.dic;
  -- vocab_withIdx.dic: Vocabulary index.

./matlab_format: Matlab format of rawText
  -- StackOverflow.mat: fea is vsm model, and gnd is the label index.

./benchmarks: Contains some benchmarks, such as classfication and clustering
  -- Classification_ACC.m: Test the classification performance with TF-IDF+SVM, and the ACC is 81.55%
  -- predict.mexw64: LibSVM libraries;
  -- svmpredict.mexw64
  -- svmtrain.mexw64
  -- train.mexw64
  -- tf_idf.m: Compute TF-IDF;
  -- Clustering_ACC_NMI.m: Test the clustering performance with TF-IDF+KMeans, and the ACC is 20.31% and NMI is 15.64% by 500 runs;
  -- normalize.m: normalize the feature vectors;
  -- bestMap.m: Permutation mapping function maps each cluster label to the equivalent label from the text data;
  -- MutualInfo.m: Compute normalized mutual information metric;

20 different labels:
  1 wordpress
  2 oracle
  3 svn
  4 apache
  5 excel
  6 matlab
  7 visual-studio
  8 cocoa
  9 osx
  10 bash
  11 spring
  12 hibernate
  13 scala
  14 sharepoint
  15 ajax
  16 qt
  17 drupal
  18 linq
  19 haskell
  20 magento