The 4DMedSea data challenge is a comparison platform that allows a sound and fair assessment of several mapping methods in the West Mediterranean region. This platform contains an input dataset (altimetric data), for anyone to create sea level and surface current maps, as well as a reference dataset (observations independant from the input dataset) in order to evaluate the methods. The data challenge is hosted in a github repository and its documentation and results are presented on this readthedocs website.
The goal of the data challenge is to evaluate the methods ability to map the sea level anomaly in the Western Mediterranean during the year 2017 (evaluation period). The input observations used to generate the maps are conventional altimeters (Saral/Altika, Jason-2, Jason-3, Sentinel-3A, Sentinel-3B, Sentinel-6, Haiyang-2B and Cryosat-2). The evaluation observations are from an independent conventional altimeter (Haiyang-2a) and drifters. The methods evaluated, so far, are MIOST and 4DVarNet. The DUACS-CMEMS product is also provided as a reference, however the DUACS product uses the independent altimeter data so the results provided should not be looked at as an assessment of the DUACS product performance.
A dataset of input observations, evaluation observations and evaluated maps is provided (see Download the data).
You can check the overall comparison for more details or click on the methods name to see their specific performances.
RMSE(SLA) | RMSE score(SLA) | Eff. res.(SLA) | |
---|---|---|---|
MIOST | 4.6 cm | 55 % | 121.3 km |
4DVarNet | 4.5 cm | 56 % | 144.1 km |
RMSE(SLA) | RMSE score(SLA) | Eff. res.(SLA) | |
---|---|---|---|
DUACS | 4.1 cm | 63 % | 103.0 km |
RMSE(SLA) | RMSE score(SLA) | Eff. res.(SLA) | |
---|---|---|---|
--- | cm | % | km |
RMSE(u) | RMSE score(u) | RMSE(v) | RMSE score(v) | |
---|---|---|---|---|
MIOST | 12.8 cm/s | 31 % | 12.7 cm/s | 29 % |
4DVarNet | 13.2 cm/s | 30 % | 13.5 cm/s | 25 % |
RMSE(u) | RMSE score(u) | RMSE(v) | RMSE score(v) | |
---|---|---|---|---|
DUACS | 12.1 cm/s | 35 % | 12.5 cm/s | 31 % |
RMSE(u) | RMSE score(u) | RMSE(v) | RMSE score(v) | |
---|---|---|---|---|
--- | cm/s | % | cm/s | % |
horizon 1d | horizon 2d | horizon 3d | horizon 4d | horizon 5d | |
---|---|---|---|---|---|
MIOST | 14.9 km | 26.9 km | 39.3 km | 50.2 km | 59.4 km |
4DVarNet | 15.1 km | 27.3 km | 39.2 km | 49.8 km | 59.4 km |
horizon 1d | horizon 2d | horizon 3d | horizon 4d | horizon 5d | |
---|---|---|---|---|---|
DUACS | 13.9 km | 25.6 km | 36.0 km | 46.0 km | 54.0 km |
horizon 1d | horizon 2d | horizon 3d | horizon 4d | horizon 5d | |
---|---|---|---|---|---|
--- | km | km | km | km | km |
The reconstruction covers the period from January 1st, 2017 to December 31st, 2017 in the Mediterranean basin from 6°W to 36°E and 30°N to 46°N.
The SSH observations used in this study comprise data from a nadir altimeter constellation that includes:
- Saral/Altika (alg),
- Jason-2 (j2, j2g, j2n),
- Jason-3 (j3, j3n),
- Sentinel-3A (s3a),
- Sentinel-3B (s3b),
- Sentinel-6 (s6),
- Haiyang-2B (h2b),
- Cryosat-2 (c2, c2n).
The Haiyang-2A (H2A) altimeter data are excluded from the mapping process to enable an independent assessment of the different reconstructions.
These data are distributed by the Copernicus Marine Service https://doi.org/10.48670/moi-0014 .
Data
- Independant nadir: Haiyang-2A (H2A)
- Independant drifters
Drifter data are also distributed by CMEMS https://doi.org/10.17882/86236 .
Metrics
Check Metrics Details:
.. toctree:: :hidden: :maxdepth: 1 :caption: The 4DMedSea project 0_projectinfo/projectinfo.md
.. toctree:: :hidden: :maxdepth: 2 :caption: Get started 1_getstarted/getstarted_install.md 1_getstarted/getstarted_navigate.md 1_getstarted/getstarted_data.md 1_getstarted/getstarted_eval.md
.. toctree:: :hidden: :maxdepth: 1 :caption: Experiment 2017 2_eval_generic/overall_movies.md 2_eval_generic/overall_scores.md 2_eval_generic/overall_nadireval.md 2_eval_generic/overall_driftereval.md 2_eval_generic/overall_trajeval.md
.. toctree:: :hidden: :maxdepth: 1 :caption: Experiment 2016-2017 3_eval_exp20162017/overall_movies.md 3_eval_exp20162017/overall_scores.md 3_eval_exp20162017/overall_nadireval.md 3_eval_exp20162017/overall_driftereval.md 3_eval_exp20162017/overall_trajeval.md
.. toctree:: :hidden: :maxdepth: 2 :caption: Metrics details 5_metrics_det/metrics_alongtrack.md 5_metrics_det/metrics_alongdrifter.md 5_metrics_det/metrics_driftertraj.md
.. toctree:: :hidden: :maxdepth: 1 :caption: Scripts 6_scripts/modules.rst