-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support for GPU in NuNET #1
Comments
Thanks for the initial specs. It seems rather clear now and good to go further. To to give an idea of how we map use-case integrations:
Which means that we have four stakeholders in this case:
Do you agree with this mapping @pgwadapool ? If yes, we can move to the next step and start clarifying details (see next comment). cc:// @JacKingt0n |
Additionally @pgwadapool , could you please provide answers to the following questions:
Based on these answers we will pick platform features from our roadmap that are needed for this use-case to work and prioritize them accordingly. Note that these platform features are application agnostic, therefore we will develop them for all subsequent applications that may run on NuNet (i.e. they will not be specific for this use-case only). |
Yes. This is fine with me. |
I should be able to cover 1, 2 and 3. For the webapp API, I will start formulating this. The high level view of the webapp is that when I wish to start the training, I will launch that in the webapp, once the training is complete, the webapp should be able to launch test. I think this will be similar to the "Dog detection" demo we had. The test will instead be of some hand written digit images. The main difference is that in the pvt alpha we mainly focused on inferencing task. In my usecase before inferencing we also need to train the ML. The webapp will provide the necessary inputs for training the model. The model can be assumed to be available in SingularityNet |
https://gitlab.com/nunet/jira-import/-/issues/126 As of today we are able to onboard GPU, run TensorFlow and PyTorch. Git clone a repo containing ML code, ran Fashion MNIST training. |
I am looking to run training algorithm (not inferencing) with NuNET just like we do in a Cloud
The first set of requirements are
Desktop Requirements
a) x86 CPU
b) At least 1 Nvidia GPU. Nvidia GPU has better support for ML
c) Atleast 32G RAM, 1TB HDD
a) OS: Ubuntu 20.04/21.04 LTS.
b) PyTorch is a must. Tensorflow. CUDA
c) cuDNN support
Data Requirements:
The first test to run will be built using PyTorch or TensorFlow depending on what is supported by NUNet. This is a simple model to learn handwritten digits.
The dataset will consist of MNIST. We will select 5000 Training samples, 500 verification sample. We will use 1000 for testing
[1] Deng, L. (2012). The mnist database of handwritten digit images for machine learning research. IEEE Signal Processing Magazine, 29(6), 141–142. http://yann.lecun.com/exdb/mnist/
The text was updated successfully, but these errors were encountered: