Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates #8

Merged
merged 4 commits into from Nov 14, 2016
Merged

Updates #8

merged 4 commits into from Nov 14, 2016

Conversation

ocefpaf
Copy link
Member

@ocefpaf ocefpaf commented Jul 28, 2016

Updated to latest 1.7.2

@conda-forge-linter
Copy link

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

@ocefpaf
Copy link
Member Author

ocefpaf commented Sep 5, 2016

The failing test,

FAIL: tsformat.test 8 - chaining set 1 with netCDF4

is mentioned in https://code.zmaw.de/attachments/12693/terminal_log.txt#L222 without any answer 😒

@Try2Code
Copy link
Contributor

Try2Code commented Oct 31, 2016

the reason is, that the hdf5-installation used by netcdf is build non-thread-safe. This tests triggers this. Here you can run checks with serialized IO with something like this:

make check CDO="${buildDir}/src/cdo -L"

@ocefpaf
Copy link
Member Author

ocefpaf commented Oct 31, 2016

the reason is, that the hdf5-installation used by netcdf is build non-thread-safe.

Do you recommend to merge this with the workaround you pasted above or should we wait for conda-forge/hdf5-feedstock#48 ?

BTW do you want to be added as a maintainer here?

PS: Can you take a look at the extra dependencies I added here. Are they OK?

@Try2Code
Copy link
Contributor

there seem to be a linking problem to jasper. you could give it a try without jasper and grib_api

or you skip jasper and add

LIBS="-lopenjpeg"

to the configure call

@Try2Code
Copy link
Contributor

About your extra dependencies:

  • AFAIK libxml2 is only needed, if you build CDO with magics++ (plotting)
  • Is ecmwf_grib the same as grib_api delivered from ECMWF?
  • CDO itself does not need libgfortran
  • the hdf5 problems are exactly triggered by the failing CDO tests. I guess, you have to enable the unsupported stuff when building hdf5. I'm not sure if the hl-interface of hdf5 is needed for netcdf4 (I guess not), but it is needed for a single CDO operator (import_cmsaf, read spec. formatted satelite data sets). You could just leave out the hdf5 dependency of CDO and do without the hl-interface, but the non-thread-safty still remains.

to become a maintainer: I'm still pretty new to conda and I do not use it regularly. So I guess, I'll cause more harm than happiness ;-)

@ocefpaf
Copy link
Member Author

ocefpaf commented Nov 7, 2016

LIBS="-lopenjpeg"

We are building ecmwf_grib with jasper, so I am not sure that will work. I will make a few test and check what we can do. If nothing works we can drop both. Hopefully the users won't loose to much functionality without them.

AFAIK libxml2 is only needed, if you build CDO with magics++ (plotting)

Good to know. We do not have a recipe foe magics++ so I am removing that.

Is ecmwf_grib the same as grib_api delivered from ECMWF?

It is. I was also used to the name grib_api, but when we added it in conda-forge we followed the scitools recipe that used the name ecmwf_grib.

You could just leave out the hdf5 dependency of CDO and do without the hl-interface, but the non-thread-safty still remains.

Do you recommend to leave it out? I am not a cdo user so I am not sure how bad that would impact them.

to become a maintainer: I'm still pretty new to conda and I do not use it regularly. So I guess, I'll cause more harm than happiness ;-)

The conda part is easy and you can leave that to me. The info you gave me above is what is we are missing 😉

@Try2Code
Copy link
Contributor

Try2Code commented Nov 7, 2016

I'd recommend to install hdf5 thread-safe. Most people will not even realise, that they area using the library and here missing thread-safty can cause real trouble. And this is not only about CDO, but possible to a large number of tools.

enable the hl-interface and thread-safe and --enable-unsupported

before some 1.8.x release, there was no need to give an extra "unsupported" flag - I guess, they got too many user requests in the past, so they dropped the support. But, I'm surley not an hdf5-expert, who knows all the internals. From a user/programmers-perspective, thread-safty definitely has a high prio.

hth
ralf

@ocefpaf
Copy link
Member Author

ocefpaf commented Nov 12, 2016

I'd recommend to install hdf5 thread-safe.

👍 but for that we need to wait for conda-forge/hdf5-feedstock#48

From a user/programmers-perspective, thread-safty definitely has a high prio.

Help us by making some noise in conda-forge/hdf5-feedstock#48 😉

@ocefpaf ocefpaf force-pushed the updates branch 5 times, most recently from 5e37bf6 to 413b00a Compare November 12, 2016 16:58
@ocefpaf
Copy link
Member Author

ocefpaf commented Nov 12, 2016

We are having many issues linking with the extra libraries on OS X (jasper, libxml2, curl, proj4, etc) not sure what is going on I know that at least jasper and proj4 were working before 😒

I do not have an OS X machine to debug this further but I will keep trying with Travis-CI.

@ocefpaf ocefpaf force-pushed the updates branch 4 times, most recently from 4c291c6 to ab5866d Compare November 14, 2016 11:30
@ocefpaf ocefpaf merged commit c9bd807 into conda-forge:master Nov 14, 2016
@ocefpaf ocefpaf deleted the updates branch November 14, 2016 15:01
This was referenced Nov 14, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants