Skip to content
Quality Control of Oceanographic Data
Python TeX Makefile
Branch: master
Clone or download

Latest commit

castelao Cleaning resources moved to pySeabird
Recently I moved all the CTD/TSG specific resources to pySeabird to
generalize CoTeDe even more. Eventually I'll replace these classes with
something generic.
Latest commit f124c94 Mar 22, 2020

Files

Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
cotede Cleaning resources moved to pySeabird Mar 26, 2020
docs A new section in the documention to list users Mar 23, 2020
joss Improving/fixing bibliography records Mar 26, 2020
tests Deepest Pressure test Jan 26, 2020
.gitattributes Setting up LFS: *.gz|nc|cdf Nov 26, 2015
.gitignore Git now ignores .swp (vim swap files) Jul 21, 2015
.travis.yml Download climatologies before running Travis tests. Mar 4, 2020
.zenodo.json Typo. May 29, 2017
AUTHORS.rst BUGFIX #37, outdated notebook on fuzzy logic. Jan 15, 2020
CONTRIBUTING.rst BUGFIX #40, do not recommend flake8 anymore. Mar 3, 2020
HISTORY.rst Updating and cleanning documentation Dec 25, 2019
LICENSE.rst Adjusting license details. Jul 14, 2015
MANIFEST.in Moving installing requirements to requirements.txt Mar 30, 2016
Makefile
README.rst Fixing documentation badge link Mar 20, 2020
environment.yml Missing xarray for binder's environment Mar 5, 2020
readthedocs.yml Using conda to build documentation (readthedocs). Aug 6, 2016
requirements.txt
setup.cfg PEP8 Mar 3, 2020
setup.py Bump version: 0.20.2 → 0.21.0 Jan 15, 2020
test-requirements.txt Updating/fixing docs' environment Aug 29, 2019
tox.ini Updating/improving TOX setup. Also limiting py27 tests. Jul 10, 2019

README.rst

CoTeDe

Documentation Status

CoTeDe is an Open Source Python package to quality control (QC) oceanographic data such as temperature and salinity. It was designed to attend individual scientists as well as real-time operations on large data centers. To achieve that, CoTeDe is highly customizable, giving the user full control to compose the desired set of tests including the specific parameters of each test, or choose from a list of preset QC procedures.

I believe that we can do better than we have been doing with more flexible classification techniques, which includes machine learning. My goal is to minimize the burden on manual expert QC improving the consistency, performance, and reliability of the QC procedure for oceanographic data, especially for real-time operations.

CoTeDe is the result from several generations of quality control systems that started in 2006 with real-time QC of TSGs and were later expanded for other platforms including CTDs, XBTs, gliders, and others.

Why use CoTeDe

CoTeDe contains several QC procedures that can be easily combined in different ways:

  • Pre-set standard tests according to the recommendations by GTSPP, EGOOS, XBT, Argo or QARTOD;
  • Custom set of tests, including user defined thresholds;
  • Two different fuzzy logic approaches: as proposed by Timms et. al 2011 & Morello et. al. 2014, and using usual defuzification by the bisector;
  • A novel approach based on Anomaly Detection, described by Castelao 2015.

Each measuring platform is a different realm with its own procedures, metadata, and meaningful visualization. So CoTeDe focuses on providing a robust framework with the procedures and lets each application, and the user, to decide how to drive the QC. For instance, the pySeabird package is another package that understands CTD and uses CoTeDe as a plugin to QC.

Documentation

A detailed documentation is available at http://cotede.readthedocs.org, while a collection of notebooks with examples is available at http://nbviewer.ipython.org/github/castelao/CoTeDe/tree/master/docs/notebooks/

You can’t perform that action at this time.