Caricoos SWAN model granules need to be removed

[rsignell-usgs]

@amilan17, I'm trying to eliminate all the bad DAP urls in the catalog, one group at a time. The UCAR and TAMU ones were huge!

So by perusing my list of good DAP urls and bad DAP urls it looks like next up for removal are 70+ bad Caricoos SWAN model granules like:

http://dm2.caricoos.org/thredds/dodsC/content/swan/201409281200.nc
http://dm2.caricoos.org/thredds/dodsC/content/swan/201409291200.nc

We don't need these because we have the Caricoos SWAN model aggregation in the catalog and it's working nicely:

http://dm2.caricoos.org/thredds/dodsC/swan/SWAN_Aggregation_best.ncd

(remember to put a URL on the end if you want to try these OPeNDAP data urls in your browser)

These datasets are coming from the harvest of this top level thredds catalog:
http://dm2.caricoos.org/thredds/catalog.html
seen here in the Collection Source:
https://www.ngdc.noaa.gov/docucomp/collectionSource/show/7367749?layout=fluid

@jcapella or @jrodriguez-caricoos, is it necessary to harvest this top level catalog?
If it is necessary, could you remove the SWAN folder from this top level catalog and make it a separate catalog?
I could help with that if necessary.

[amilan17]

Can you please tell me which services need to be removed and/or cleaned out?
Thanks - anna

https://www.ngdc.noaa.gov/docucomp/collectionSource/list?max=10&serviceStatus=&recordSetId=3573894&search=List+Collection+Sources&layout=fluid&serviceType=&offset=20&serviceUrl=&componentId=

[rsignell-usgs]

@amilan17, I decribe the service in question here:
#58 (comment)
we need to find out from @jcapella or @jrodriguez-caricoos if removing this catalog will have other impacts.

[jcapella]

Will get back to you as soon as I'm back at the office, tomorrow.

On Mon, Oct 6, 2014 at 12:54 PM, Rich Signell notifications@github.com
wrote:

@amilan17 https://github.com/amilan17, I decribe the service in
question here:
#58 (comment) #58 (comment)
we need to find out from @jcapella https://github.com/jcapella or
@jrodriguez-caricoos https://github.com/jrodriguez-caricoos if removing
this catalog will have other impacts.

—
Reply to this email directly or view it on GitHub
#58 (comment).

[amilan17]

@jcapella @rsignell-usgs
any followups on whether to perform a clean up or removal of this service:
https://www.ngdc.noaa.gov/docucomp/collectionSource/show/7367749?layout=fluid

[rsignell-usgs]

It looks like one of @jcapella gang has cleaned up the top level catalog
http://dm2.caricoos.org/thredds/catalog.html
so that it points to separate catalogs now.

So definitely I would stop harvesting
http://dm2.caricoos.org/thredds/catalog.html
and remove all the datasets that were harvested from there.

[jcapella]

We are trying to get things in order. Are we now talking ROMS or SWAN?
ROMS was depurated and only r1 remains in public view , and should be
aggregated. What's the problem with SWAN?

On 11/28/2014 8:22 AM, Rich Signell wrote:

It looks like one of @jcapella https://github.com/jcapella gang has
cleaned up the top level catalog
http://dm2.caricoos.org/thredds/catalog.html
so that it points to separate catalogs now.

So definitely I would stop harvesting
http://dm2.caricoos.org/thredds/catalog.html
and remove all the datasets that were harvested from there.

—
Reply to this email directly or view it on GitHub
#58 (comment).

[rsignell-usgs]

@jcapella, the problem isn't on your end anymore -- you have cleaned things up nicely.
@amilan17 just has to clean up the metadata catalog as it still has all those SWAN daily datasets that were replaced by your SWAN aggregation.

[amilan17]

@rsignell-usgs @jcapella
Changed status in collectionSource table to "For Removal'.
http://www.ngdc.noaa.gov/docucomp/collectionSource/show/7367749

[amilan17]

@rsignell-usgs @jcapella
The granules have been cleaned up. There is now only ONE record in the CariCOOS WAF.
http://www.ngdc.noaa.gov/metadata/published/NOAA/IOOS/CariCOOS/iso/

[jcapella]

Thanks Anna and Rich.

On 12/2/2014 12:51 PM, Anna Milan
  wrote:


  @rsignell-usgs
    @jcapella 
    The granules have been cleaned up. There is now only ONE record
    in the CariCOOS WAF. 
    http://www.ngdc.noaa.gov/metadata/published/NOAA/IOOS/CariCOOS/iso/
  —
    Reply to this email directly or view
      it on GitHub.