Skip to content
master
Switch branches/tags
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 

RaRecognize

Requirements:

The code is written and run in Python 3.6.8 on a Ubuntu Linux system and requires the following standard Python packages: sklearn, imblearn, tqdm, numpy and pandas.

Our implementation uses spot (https://github.com/Amossys-team/SPOT) to learn classification threshold. For convenience purposes, we include spot source code in Python here, however, for more details please refer to the original source.

Instructions to prepare data and run RaRecognize:

1. Prepare data:

This step generates 5 random train/test splits, transform text into numerical vector using TFIDF (1K), PCA (99%) and ICA (same #dimension as PCA) and store them in test_data folder. We include the public NYTimes disaster dataset with news articles from 13 different disaster classes in the data folder.

python setup_experiment_data.py

Here the random splits are indexed from 0 to 4.

2. Run RaRecognize:

1K TFIDF: to run RaRecognize when 1K TFIDF features are use and for a random split, e.g. 0,

./run_RaRecognize_1k.sh 0

PCA: to run RaRecognize when PCA with 99% variance is preserved and for a random split, e.g. 0,

./run_RaRecognize_pca.sh 0

ICA: to run RaRecognize when ICA with the same number of features as PCA is used and for a random split, e.g. 0,

./run_RaRecognize_ica.sh 0

Note:

If you use any parts of this code for research purposes, please make sure to cite the following paper. Also note that the code is not allowed for use for purposes other than research.

@inproceedings{nguyen2019rarecognize,
    author = {Nguyen, Hung and Wang, Xuejian and Akoglu, Leman},
    title = {Continual Rare-Class Recognition with Emerging Novel Subclasses},
    booktitle={Joint European Conference on Machine Learning and Knowledge Discovery in Databases (ECML-PKDD)},
    year={2019},
    organization={Springer}
}

About

Implementation of RaRecognize (ECML 2019)

Resources

License

Releases

No releases published

Packages

No packages published