Implemented Nvidia DevicePlugin GPU Support on AWS

[dcwangmit01]

• Supports DevicePlugin GPU Mode AND Legacy Accelerators GPU Mode

===
Rendered Readme Found Here
https://github.com/dcwangmit01/kops/tree/gpu-device-plugins-3/hooks/nvidia-device-plugin

Related Issues:

• Provide a pathway for installing Device Support on kops #4591
• GPU for newer kubernetes versions #5135
• Provide a pathway for installing Device Support on kops #4591

Related Pull Requests:

• [GPU] Updated Kops GPU Setup Hook #4971

[mikesplain]

/ok-to-test

[dcwangmit01]

Tagging those who reviewed/commented on prior GPU PR #4971.

This PR adds Kops GPU support for kubernetes >= 1.11.0 via DevicePlugins.

@115100, @bhack, @chrislovecnm, @erez-rabih, @faheem-cliqz, @flx42, @justinsb, @KashifSaadat, @mikesplain, @mindprince, @richardbrks, @rtluckie

[bhack]

Is cuda mandatory?

[dcwangmit01]

@bhack Cuda is not mandatory, but included here to follow the same practice as the other GPU hook images.

[bhack]

@dcwangmit01 ok but I suppose this will duplicate the node storage consumption when we use pod with image derived from nvidia/cuda like Tensorflow etc..

[bhack]

I.e. https://github.com/tensorflow/tensorflow/blob/master/tensorflow/tools/docker/Dockerfile.gpu#L1

[flx42]

FYI this base image doesn't have any CUDA library (apart from libcudart), so you won't get any layer sharing with other CUDA apps; only if you run multiple instances of this image.

[bhack]

@flx42 Yes but I meant that in 90% of the cases the next command is to apt-get cuda-*

[flx42]

I agree CUDA toolkit libraries shouldn't be part of a driver install.

[darkyat]

Tested and works. Can this be merged, @mikesplain?

[faheem-nadeem]

Tested and works as expected. Awesome work thanks.

[justinsb]

This is purely additive, so I'm going to merge it in :-)

I've added myself a TODO item to build the docker image as part of the kops release and repoint it, so we won't be relying on your docker images @dcwangmit01 !

Thank you so much @dcwangmit01

/approve
/lgtm

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: dcwangmit01, justinsb

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [justinsb]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment