Cannot download naciscdn.org data from naturalearthdata.com

[yoheym]

Hi all. Any help would be greatly appreciated.

When I attempt to download https://naciscdn.org/naturalearth/110m/physical/ne_110m_ocean.zip, , the request times out.

[nvkelso]

I’m working to repoint the naciscdn.org domain at the new S3 buckets this weekend.

…

On Sep 3, 2021, at 16:48, yoheym ***@***.***> wrote:  Hi all. Any help would be greatly appreciated. When I attempt to download https://naciscdn.org/naturalearth/110m/physical/ne_110m_ocean.zip, , the request times out. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or unsubscribe.

[ldekay]

I assume you're still working on this because I can't get to https://www.naturalearthdata.com/http//www.naturalearthdata.com/download/10m/raster/OB_LR.zip
Responds with This site can’t be reached naciscdn.org took too long to respond.
Any ETA for the repoint???

[fernsehmuell]

Hello, are there any news on the naciscdn.org outage?

[nvkelso]

The original private server backing naciscdn.org seems to be busted.

I'm in the process of redirecting to S3. Here are some file resource patterns in the meantime:

Official S3 public data: (EVERYONE SHOULD MIGRATE HERE, ESPECIALLY IF YOU USE CI)
https://naturalearth.s3.amazonaws.com/10m_cultural/10m_cultural.zip
(note 10m_cultural where naturalearthdata.com uses 10m/cultural with / not _ so you'll need to update more than your domain)

Eventually this will get naciscdn.org pretty domain:
https://s3.us-west-2.amazonaws.com/naciscdn.org/naturalearth/10m/cultural/10m_cultural.zip
(same file structure as naturalearthdata.com)

[dwnadler]

Is there a way to download a raster file with an AWS link?

[nvkelso]

Oops, I missed the rasters the first attempt, thanks for flagging that. Adding the 10m and 50m rasters now.

[nvkelso]

@dwnadler The rasters should all be there now.

[jjakoboski]

Is this still down? I currently can't access the server at naciscdn.org. Thanks :)

[raybellwaves]

FWIW I downloaded data from the S3 URL using geopandas
gpd.read_file("https://naturalearth.s3.amazonaws.com/10m_cultural/ne_10m_populated_places.zip")

[ldekay]

I was able to download https://naturalearth.s3.amazonaws.com/10m_physical/ne_10m_bathymetry_all.zip by going to https://naturalearth.s3.amazonaws.com/ and going through the file listings until I found 10m_physical/ne_10m_bathymetry_all.zip. Concatenated the two strings in a link and used that to download. Tedious but effective. *Lloyd DeKay*

…

On Wed, Sep 8, 2021 at 11:18 AM Ray Bell ***@***.***> wrote: FWIW I downloaded data from the S3 URL using geopandas gpd.read_file(" https://naturalearth.s3.amazonaws.com/10m_cultural/ne_10m_populated_places.zip ") — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#581 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AJDMH24CIYQAKR6IEQSQ2U3UA6SGLANCNFSM5DMUS57Q> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

[DanielJWood]

If you need to find one of these links and made it this far, here they are in a gist, until the site is restored. Taken from the index at https://naturalearth.s3.amazonaws.com/

https://gist.github.com/DanielJWood/b71237cc200831acf8e637c05ce2c375

[ldekay]

Daniel, I wanted to say thank you for your hard work on getting this database back up and running. It looks like it's been a fairly monumental task so far, but it's a valuable database that the public needs, nd your efforts are key to keeping it available to the public. I just wanted to let you know how much you're appreciated. Cheers, *Lloyd DeKay*

…

On Thu, Sep 9, 2021 at 9:25 AM Daniel Wood ***@***.***> wrote: If you need to find one of these links and made it this far, here they are in a gist, until the site is restored. Taken from the index at https://naturalearth.s3.amazonaws.com/ https://gist.github.com/DanielJWood/b71237cc200831acf8e637c05ce2c375 — You are receiving this because you commented. Reply to this email directly, view it on GitHub <#581 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AJDMH2Y2QWHZWU3NVZQRBV3UBDNV5ANCNFSM5DMUS57Q> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.

[jjakoboski]

Downloaded the files successfully from https://naturalearth.s3.amazonaws.com/10m_physical/ne_10m_coastline.zip - thank you!

[julia-remke]

Hey!
First of all thanks for sharing the downloads! I have all of the data saved locally now, but cartopy still wants to download the packages from naciscdn.org. How do I tell the programm to use the local files instead of trying to download?
I tried changing the config with cartopy.config['pre_existing_data_dir']=expanduser('~/cartopy-data') but it still won't work. Might be a stupid question, but help would be appreciated!

Julia

[SomeoneElseOSM]

@https://github.com/julia-remke I'm not a cartopy user, but SciTools/cartopy#1833 and SciTools/cartopy#1849 suggests that a new release of cartopy (v0.20.0) should address this. If you're using that and it still doesn't work, that's probably something to raise at https://github.com/SciTools/cartopy/issues .

[ttruksa]

@julia-remke I'm in the same situation. It still seems to be pulling from the non-AWS site and I'm not sure how to change that.

[mccartneypaul]

@ttruksa I ended up just downloading them manually and putting them into cartopy's offline data. ...You may also need the cartopy offline data package as well. (https://github.com/willirath/cartopy_offlinedata) Not sure, as I ended up going with folium...

>>> import cartopy.config
>>> cartopy.config['data_dir']
'/home/pelson/.local/share/cartopy'

[nvkelso]

The http version of the naciscdn.org links should now work again.

Next up the https version (which is used by naturalearthdata.com download redirects).

[nvkelso]

The https versions should also now work again, meaning downloads from naturalearthdata.com should be operational again.

[nvkelso]

For posterities sake, the nameservers configs were scrambled / not auto generated correctly. Manually setting them to the same 4 values in all the places corrected the problem, and unblocked adding the SSL cert.