Earth wdmam 2.2

[Esteban82]

Update recipe for earth wdmam 2.2. See #245

[Esteban82]

In the recipe it says:
# SRC_FILE=ftp://ftp.soest.hawaii.edu/pwessel/WDMAM/grid.asc.txt
Where should I put the original txt file? I think I can't use the original source (https://wdmam.org/) because it is necessary to log in to download the data. This is the same issue discused on #268. I think we can use the same server. My question is where exactly should I put it? In /export/gmtserver/pwessel ?

[joa-quim]

I find the data in the gmtserver too messy for me to understand it. IMO, we should remove all old-earth-relief*_ directories and the files in candidate be removed after they are upgraded from candidate to final. The WDMAM file should be only stored as a .nc grid and no grid.asc.txt, if I understand it well it's a ascii version of the grid, and stored under /export/gmtserver/gmt/data/server/earth/earth_wdmam

[Esteban82]

I find the data in the gmtserver too messy for me to understand it. IMO, we should remove all old-earth-relief*_ directories

Yes, I agree that we should delete those 3 directories.

and the files in candidate be removed after they are upgraded from candidate to final.

Yes, I agree. Paul wrote this in the makefile. So I think we should do it.

# Completely wipe the candidate/server directory on the candidate server
candidate-delete:
		ssh candidate.generic-mapping-tools.org "rm -rf /export/gmtserver/gmt/candidate/server; mkdir /export/gmtserver/gmt/candidate/server"

The WDMAM file should be only stored as a .nc grid and no grid.asc.txt, if I understand it well it's a ascii version of the grid

Sounds good. But if the nc is stored, then I think the followings lines (in the recipe) should be edited/deleted. I could try to do it.

# Since source is an ASCII grid we supply conversion command and original extension
# SRC_CUSTOM="gmt xyz2grd grid.asc.txt -i0,1,2 -Rd -I3m -fg -Ggrid.asc.nc"
# SRC_EXT=txt

and stored under /export/gmtserver/gmt/data/server/earth/earth_wdmam

I think if we put it there, then it will be copied by the other mirrors. I think it would be better to put it in a directory outside of gmt/data/. Maybe something like /export/gmtserver/gmt/backup_data/, /export/gmtserver/gmt/original_data/ or /export/gmtserver/gmt/source_data/.

[joa-quim]

I think if we put it there, then it will be copied by the other mirrors.

Yes, that's the whole idea. I don't see why we should be keeping a copy of the original ascii data. Just store the nc version and get rid of the temporaries.

[seisman]

Sounds good. But if the nc is stored, then I think the followings lines (in the recipe) should be edited/deleted. I could try to do it.

# Since source is an ASCII grid we supply conversion command and original extension
# SRC_CUSTOM="gmt xyz2grd grid.asc.txt -i0,1,2 -Rd -I3m -fg -Ggrid.asc.nc"
# SRC_EXT=txt

I don't think the SRC_CUSTOM line should be edited. It's the command to convert the original ascii file to the nc grid we need. If you remove it, next time, we may have no idea how to do the ascii->nc conversion.

[Esteban82]

I don't think the SRC_CUSTOM line should be edited. It's the command to convert the original ascii file to the nc grid we need. If you remove it, next time, we may have no idea how to do the ascii->nc conversion.

Yes, thanks. It is important to save this info.

[Esteban82]

Update the recipe. Just so you can see it. It's not meant to be defining.

With the current version, you can make earth-wdmam and it works fine.

First, I did what I put in the comments:

# Data must first be downloaded from https://wdmam.org/ manually.
# Then converted to grid file with "gmt xyz2grd grid.txt -i0,1,2 -Rd -I3m -fg -Gearth_wdmam_2.2.nc",
# and finally place it this directory on the candidate server https://candidate.generic-mapping-tools.org/

I don't like having to put the file on the candidate server. It is confusing and may be deleted. I created the directory /export/gmtserver/gmt/source_data but I don't know what is the URL to access that folder. Do you know how to do it?

[Esteban82]

Yes, that's the whole idea. I don't see why we should be keeping a copy of the original ascii data. Just store the nc version and get rid of the temporaries.

I don't know if I understood correctly. I have the impression that you are confusing the grid.nc file (that I now call earth_wdmam_2.2.nc and that is in the candidate server) with the files that are downloaded by the users when they do @earth-wdmam. The earth_wdmam_2.2.nc file is processed to create the other files. That's why I don't see sense that the earth_wdmam_2.2.nc file is copied by the mirrors.

[seisman]

Looks good to me.