Show all ODP data sources

[forman]

Expected behavior

Cate Desktop should show all available CCI data sources available through the ODP. Also CLI and API should list all of them.

Data sources that cannot be accessed through ODP "standard" protocols HTTP and OPeNDAP URLs should provide a URL for manual download, e.g. from FTP. GUI should display that link.

Expansion stages:

1. If the FTP URL is known, the Cate ODP data store should make transparent use of that same as for HTTP, i.e. synchronize it locally.
2. Ideally, CCI data sources that are known to have limited functionality in Cate should be labelled. GUI, CLI, API Desktop should display/provide those labels.

Actual behavior

Cate only shows ODP data sources for gridded data that have a NetCDF file representation. This is because we derive data sources from ODP ESGF service and expand it with metadata from ODP CSW.

Actually we should do it the other way round, query the CSW for all data sources and obtain extra meta-data and URLs for the gridded datasets from ESGF.

Steps to reproduce the problem

1. Go to ODP web page and see all available datasets
2. Start Cate Desktop and have a look at all available datasets in DATA SOURCES panel
3. Recognise the difference.

Specifications

Cate 1.0 - 2.0.dev20

[philipkershaw]

Looks good to me:

Actually we should do it the other way round, query the CSW for all data sources and obtain extra meta-data and URLs for the gridded datasets from ESGF.

Nb. FTP is a "standard" protocol for the ODP :)