Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Port h2o4gpu to h2o-3 #753

Open
jtelleria opened this issue Apr 6, 2019 · 3 comments
Open

Port h2o4gpu to h2o-3 #753

jtelleria opened this issue Apr 6, 2019 · 3 comments
Milestone

Comments

@jtelleria
Copy link

Could it be possible to port h2o4gpu Algorithms to h2o-3?

@mdymczyk
Copy link
Contributor

mdymczyk commented Apr 8, 2019

@jtelleria by port I'm assuming you're asking for GPU implementation in h2o-3 since h2o-3 already has almost all the algos h2o4gpu has.

This was actually the reason why we moved from using CTypes to SWIG so we could use it from Java and h2o-3 but I never had the time to integrate it and I doubt @sh1ng (who's now in charge of this repo) has.

Furthermore, h2o4gpu algos are not distributed (or well not in the h2o-3 sense) so they would still run only on a single machine.

You're welcome to try and contribute this to the h2o-3 repository, if you want though. We already did something similar with XGboost so you could use that as an example.

@sh1ng sh1ng added this to the Greener grass milestone Apr 8, 2019
@sh1ng
Copy link
Contributor

sh1ng commented Apr 8, 2019

Due to compilation for multiple GPU's architectures h2o4gpu package is quite big(>300Mb). People who is not going to use it should not pay for it. We could implement lazy loading of the package, but that plus supporting Java binding and unification of the API will take some time. Not our first priority(in favour to more CUDA algos), but let's keep.

@mdymczyk
Copy link
Contributor

mdymczyk commented Apr 9, 2019

@sh1ng the module system in h2o-3 is based on Java classpath mechanism so we probably could just make the h2o4gpu a separate Java jar and users would just pass it to the classpath when starting h2o-3, don't need to bundle it with h2o-3.jar. But the other issues you raised still stay :-)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants