sextant.rst

Sextant

TensorBay SDK supports methods to interact with sextant application. See authorized storage instruction for details about how to start.

Authorize a Sextant Instance

../../../docs/code/sextant.py

List or get benchmark

../../../docs/code/sextant.py

Create a evaluation

A evaluation must be created by one commit.

../../../docs/code/sextant.py

List all evaluations

../../../docs/code/sextant.py

get evaluation result

../../../docs/code/sextant.py

The details of the result structure for the evaluation are as follows:

{
    "result": {
        "categories": {
            "aeroplane": {
                "AP": 0.3,
                "averageIoU": 0.71,
                "pr": {
                    "precision": [0.87, 0.8, ...],
                    "recall": [0.001, 0.0045, ...]
                }
            },
            ...
        },
        "overall": {
            "averageIoU": 0.7,
            "mAP": 0.2,
            "pr": {
                "precision": [0.95, 0.91, ...],
                "recall": [0.0036, 0.01, ...]
            }
        }
    }
}

Note

Benchmark can only be created with tensorbay website now.