A Python library for calculating and displaying the skill of model predictions against observations.
Switch branches/tags
Nothing to show
Clone or download
PeterRochford Target & Taylor Diagrams.docx
A 6-page description of target and Taylor diagrams as visual tools to aid in the analysis of model predictive skill. The figures used were generated with the SkillMetrics python package.
Latest commit 55d5d86 Apr 27, 2018
Permalink
Failed to load latest commit information.
Documents
Examples Improved location and appearance of RMSD label on Taylor diagrams. Nov 29, 2017
skill_metrics
.project
.pydevproject Implemented better default angle for placement of RMS contour values. May 6, 2017
LICENSE.txt
MANIFEST.in Create MANIFEST.in Dec 23, 2016
README.rst
requirements.txt Create requirements.txt Dec 23, 2016
setup.py Added Python 3 compatible pickle files. May 6, 2017

README.rst

SkillMetrics Project

This package contains a collection of functions for calculating the skill of model predictions against observations. It includes metrics such as root-mean-square-error (RMSE) difference, centered root-mean-square (RMS) difference, and skill score (SS), as well as a collection of functions for producing target and Taylor diagrams. The more valuable feature of the package are the plotting functions for target and Taylor diagrams and the ability to easily customize the diagrams.

Features

  • Statistical metrics such as root-mean-square-error (RMSE) difference, centered root-mean-square (RMS) difference, and skill score (SS)
  • Functions to calculate statistical metrics for target & Taylor diagrams
  • Target Diagrams
  • Taylor Diagrams
  • Options to control plot features such as color of labels and lines, width of lines, choice of markers, etc.
  • Output of graphics to PNG format.

Installing

To install the package simply use the pip command:

$ pip install SkillMetrics

If you are upgrading the package then include the upgrade option:

$ pip install SkillMetrics --upgrade

Examples

A primer on Taylor diagrams as well as an "Examples" folder that contains a collection of example Python scripts showing how to produce target and Taylor diagrams in a variety of formats is available via a GitHub Wiki at https://github.com/PeterRochford/SkillMetrics/wiki. There are 7 examples for target diagrams and 9 examples for Taylor diagrams that successively progress from very simple to more customized figures. These series of examples provide an easy tutorial on how to use the various options of the target_diagram and taylor_diagram functions. They also provide a quick reference in future for how to produce the diagrams with specific features. The diagrams produced by each script are in Portable Network Graphics (PNG) format and have the same file name as the script with a "png" suffix. Examples of the diagrams produced can be found on the Wiki.

There is also a simple program "all_stats.py" available via the Wiki that provides examples of how to calculate the various skill metrics used or available in the package. All the calculated skill metrics are written to an Excel file for easy viewing and manipulation. The Python code is kept to a minimum.

Available Metrics

Here is a list of currently supported metrics. Examples of how to obtain them can be found in the "all_stats.py" program.

Metric Description
bias Mean error
BS Brier score
BSS Brier skill score
r-square Correlation coefficient
CRMSD centered root-mean-square error deviation
RMSD root-mean-square error deviation
SS Murphy's skill score
STD standard deviation