Statistical comparison of multiple algorithms
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
R
data Bayesian analysis introduced Nov 21, 2017
inst Bayesian Plackett-Luce incorporated Jan 12, 2018
man
vignettes
.Rbuildignore First commit Mar 1, 2015
DESCRIPTION Bayesian Plackett-Luce incorporated Jan 12, 2018
NAMESPACE
README.md
Rplot.pdf
scmamp.Rproj

README.md

scmamp: Statistical Comparison of Multiple Algorithms in Multiple Problems

This is a simple R package aimed at simplifying the statistical analysis of the results in the comparison of algorithms in different problems.

It is mainly focused on non parametric methods and implements Shaffer static and Bergmann and Hommel dynamic corrections for pairwise tests.

The package also includes some plotting tools, such as the critical difference plots shown in Demšar, J., 2006. Indeed, the package is mainly based on the papers:

Demšar, J. (2006) Statistical Comparisons of Classifiers over Multiple Data Sets. Journal of Machine Learning Research, 7, 1-30.

García S. and Herrera, F. (2008) An Extension on "Statistical Comparisons of Classifiers over Multiple Data Sets" for all Pairwise Comparisons. Journal of Machine Learning Research, 9, 2677-2694.

García S. and Herrera, F. (2010) Advanced Nonparametric Tests for Multiple Comparison in the Design of Experiments in Computational Intelligence and Data Mining: Experimental Analysis of Power. Information Sciences, 180, 2044-2064.

Package installation

The last version of the package can be installed running the following commands:

if (!require("devtools")) {
  install.packages("devtools")
}

devtools::install_github("b0rxa/scmamp")

The package can also be installed using the tar.gz files in the root directory. First, download the scmamp_*.tar.gz file and install it running:

install.packages(path.tar.gz.file, reps=NULL)

where path.tar.gz.file refers to the path of the downloaded file. Note that these files may not be up to date.

Documentation

The package includes two vignettes, one for the basic use and another with information about the data manipulation. To access to the local versions of these vignettes (once the package is installed):

library("scmamp")
browseVignettes("scmamp")