improv(package): use python slim base image and let pytorch install cuda

[larme]

We can let pytorch install it's own cuda runtime and save some duplicate spaces

[aarnphm]

I think the reason why we set the base image to use cuda is that all bento will be idempotent.

It won't depend on machine host cuda version. Therefore, a drawback is that we will have to download the binary twice.

[larme]

I think the reason why we set the base image to use cuda is that all bento will be idempotent.

It won't depend on machine host cuda version. Therefore, a drawback is that we will have to download the binary twice.

It won't depend on machine host cuda version because pytorch will download cuda runtime version that suitable to this pytorch version.

Host's cuda version is just cuda driver version, which is compatible with higher cuda runtime version, which is installed inside the docker container by pytorch. So we are not depending on host's cuda version in most case

[aarnphm]

I think the reason why we set the base image to use cuda is that all bento will be idempotent.
It won't depend on machine host cuda version. Therefore, a drawback is that we will have to download the binary twice.

It won't depend on machine host cuda version because pytorch will download cuda runtime version that suitable to this pytorch version.

Host's cuda version is just cuda driver version, which is compatible with higher cuda runtime version, which is installed inside the docker container by pytorch. So we are not depending on host's cuda version in most case

This is not true, because pytorch will still pick up host machine cuda nonetheless. So if the container doesn't have a cuda, and host machine has older cuda, then it won't work.

We have seen this on bentocloud b4. Hence, this is the current fix.

[larme]

We have seen this on bentocloud b4. Hence, this is the current fix.

Was this the test done with xipeng? I think we (xipeng, jiangbo and me) have verified that pytorch will install cuda regardless if host cuda is available. @yetone could you confirm?

[aarnphm]

We have seen this on bentocloud b4. Hence, this is the current fix.

Was this the test done with xipeng? I think we (xipeng, jiangbo and me) have verified that pytorch will install cuda regardless if host cuda is available. @yetone could you confirm?

Yes we decided that we still set cuda as base image so that the future update won't break old bento.