Installing GPU support on Mac #9217

helloniklas · 2017-12-28T16:31:47Z

Anyone managed to install GPU support on macOS? I've got an eGPU running with NVIDIA card. Installed CUDA 9 with cuDNN (version 8 does not seem to run on macOS 10.13.2).

I've read some posts saying that CUDA 9 was supported from MXNET v 0.12.

Running a command like pip install mxnet-cu90 does not work though.

szha · 2017-12-28T19:32:04Z

GPU version of osx is currently not supported through pip.

You can try to build from source. A while back I was able to build mxnet with cuda 8 on OSX.

helloniklas · 2017-12-28T19:35:15Z

@szha right, got you, thanks. So do you know if MXNET 1.0.0 in theory will support cuda 9 if I attempt to build from source.

helloniklas · 2017-12-28T19:38:58Z

@szha Also, it seems Python can't be supported if building from source? https://mxnet.incubator.apache.org/get_started/build_from_source.html

szha · 2017-12-29T03:49:51Z

Yes, mxnet 1.0.0 should support cuda 9 when building from source.

The build process is for building the shared object of mxnet, which is a dependency of the python language binding of mxnet. The python language binding doesn't require building so there is no doc listed.

helloniklas · 2017-12-31T20:29:56Z

@szha thanks, can confirm it all works, running macOS 10.13.2 with Cuda 9.1 and cuDNN 7 on a MacBook Pro with Sonnett ePGU and GeForce 1080 gpu.

Training the lenet example takes 36 seconds now vs. 14 minutes and 11 seconds on cpu.

Cosmo · 2018-01-03T00:17:40Z

@helloniklas I have a similar setup (macOS 10.13.2, GeForce 1080, cuda 9.1 and cuDNN 7).
would you mind to share the steps you took, to build and run mxnet on your machine?

thanks, any help appreciated!

helloniklas · 2018-01-03T10:44:30Z

@Cosmo

Download Xcode8.3.3 from Apple. This is the version NVIDIA state for Cuda 9.1 Mac. Unzip and rename to Xcode8.3.3.app.
Run sudo xcode-select -s /Applications/Xcode8.3.3.app or to wherever you have placed Xcode.
Run xcode-select --install to install all command line tools compilers etc.
Run git clone --recursive https://github.com/apache/incubator-mxnet.git mxnet to get the latest version currently 1.0.1 which worked for me.
cd mxnet
Edit the make/osx.mk file to set

USE_CUDA = 1
USE_CUDA_PATH = /usr/local/cuda
USE_CUDNN = 1
USE_OPENCV = 0

Copy the mxnet/make/osx.mk to mxnet/config.mk
Run make If you previously attempted to compile you might want to do make clean_all first. You can also run make -j to compile with multithreading. There'll be plenty of warnings but should be no errors.
Once finished you should have a file called libmxnet.so in mxnet/lib/
Do cd python
Run sudo python setup.py install
Do cd .. then you should be able to run python example/image-classification/train_mnist.py --network lenet --gpus 0 to test GPU training.

Cosmo · 2018-01-03T13:17:48Z

Wohoo, it works! Thank you very much! :)
Let's hope that Turi Create will get support for 1.x

aaronmarkham · 2018-01-08T18:31:20Z

Thanks @helloniklas!
I'll be adding these instructions to the install area. Please ping me if you uncover any refinements that should be mentioned.

aaronmarkham · 2018-01-17T22:04:38Z

Was anyone able to confirm that the Mac GPU build will work with OpenCV support (USE_OPENCV=1) in the config?
@Cosmo
@helloniklas

Cosmo · 2018-01-17T23:26:28Z

@aaronmarkham Haven't tried unfortunately. I'm back on my machine by end of jan. I assume, it's a bit too late :|

aaronmarkham · 2018-01-22T20:04:54Z

Hi @Cosmo - we're trying to wrap up the instructions for the next incremental release which is imminent. Either way, let me know if you can confirm, and I'll update the install info whenever you can try it out with OpenCV.

shankarrajus · 2018-01-29T23:54:06Z

Hi @helloniklas,
Thank you so much for the detailed instruction. I think it worked. It took me around 4 minutes to complete 19 epochs, is it good? (I am new to this DL).

It said something about "MXNET_CUDNN_AUTOTUNE_DEFAULT = 0" do I need to worry about it?

[05:10:49] src/operator/nn/./cudnn/./cudnn_algoreg-inl.h:107: Running performance tests to find the best convolution algorithm, this can take a while... (setting env variable MXNET_CUDNN_AUTOTUNE_DEFAULT to 0 to disable)
INFO:root:Epoch[0] Batch [100] Speed: 4560.95 samples/sec accuracy=0.876702
...
INFO:root:Epoch[19] Batch [900] Speed: 5639.22 samples/sec accuracy=1.000000
INFO:root:Epoch[19] Train-accuracy=1.000000
INFO:root:Epoch[19] Time cost=10.585
INFO:root:Epoch[19] Validation-accuracy=0.992138

rafaelsimonmaia · 2018-02-20T06:10:11Z

Hi @helloniklas, could you remove the space after USE_CUDA = 1. It is just a minor detail that may make it fail to compile if someone just copies that code without paying attention. Thanks!

bradcar · 2018-04-05T16:01:43Z

Hi, @helloniklas I just tried to use your instructions with 10.13.4, Run git clone --recursive https://github.com/apache/incubator-mxnet.git mxnet which gets the latest version which is 1.1.0
and I get the following error:

In file included from src/operator/nn/cudnn/../../../common/cuda_utils.h:31:
/Users/bradcarlile/mxnet/3rdparty/mshadow/mshadow/base.h:147:14: fatal error: 'cblas.h' file not
found
#include <cblas.h>
^~~~~~~~~
1 error generated.

ideas?

szha · 2018-04-05T16:09:07Z

@bradcar Change the USE_BLAS in config.mk to 'apple'.

bradcar · 2018-04-05T16:20:27Z

my config.mk has the following:

USE_BLAS = apple

szha · 2018-04-05T16:45:23Z

@bradcar would you mind sharing some of the compilation outputs from the terminal?

bradcar · 2018-04-05T17:14:57Z

sure, thanks in advance for your help...
cblas-notfound.txt

szha · 2018-04-05T17:49:18Z

No problem. The error that you shared is the missing cblas.h. I checked the compilation line for the problem source, and it looks like this:

g++ -std=c++11 -c -DMSHADOW_FORCE_STREAM -Wall -Wsign-compare -O3 -DNDEBUG=1 -I/Users/bradcarlile/mxnet/3rdparty/mshadow/ -I/Users/bradcarlile/mxnet/3rdparty/dmlc-core/include -fPIC -I/Users/bradcarlile/mxnet/3rd
party/nnvm/include -I/Users/bradcarlile/mxnet/3rdparty/dlpack/include -I/Users/bradcarlile/mxnet/3rdparty/nnvm/tvm/include -Iinclude -funroll-loops -Wno-unused-parameter -Wno-unknown-pragmas -Wno-unused-local-typ
edefs -msse3 -I/usr/local/cuda/include -DMSHADOW_USE_CBLAS=1 -DMSHADOW_USE_MKL=0 -I/System/Library/Frameworks/Accelerate.framework/Versions/Current/Frameworks/vecLib.framework/Versions/Current/Headers/ -DMSHADOW_
RABIT_PS=0 -DMSHADOW_DIST_PS=0 -DMSHADOW_USE_PASCAL=0 -DMXNET_USE_OPENCV=0 -DMXNET_USE_LAPACK -DMSHADOW_USE_CUDNN=1  -I/Users/bradcarlile/mxnet/3rdparty/cub -DMXNET_ENABLE_CUDA_RTC=1 -DMXNET_USE_NCCL=0 -DMXNET_US
E_LIBJPEG_TURBO=0 -MMD -c src/operator/contrib/krprod.cc -o build/src/operator/contrib/krprod.o

Note that there is -I/System/Library/Frameworks/Accelerate.framework/Versions/Current/Frameworks/vecLib.framework/Versions/Current/Headers/. In that place, I was able to find cblas.h on my machine. Could you check whether it's the case for you?

szha · 2018-04-05T18:28:20Z

According to this doc from OS X, you need OS X 10.0+ to get veclib.

bradcar · 2018-04-05T22:58:35Z

I have two macs 10.12.6 and 10.13.4 . I could not find cblas.h in
/System/Library/Frameworks/Accelerate.framework/Versions/Current/Frameworks/vecLib.framework/Versions/Current/Headers/

There is no Headers directory in /System/Library/Frameworks/Accelerate.framework/Versions/Current/Frameworks/vecLib.framework/Versions/Current/ All I see is:
Resources libBNNS.dylib libQuadrature.dylib libvDSP.dylib
_CodeSignature libLAPACK.dylib libSparse.dylib libvMisc.dylib
libBLAS.dylib libLinearAlgebra.dylib libSparseBLAS.dylib vecLib

szha · 2018-04-05T23:15:42Z

I'm not sure what's happening there... Is xcode on your machine?

bradcar · 2018-04-05T23:37:51Z

xcode Version 9.3 (9E145)

bradcar · 2018-04-06T00:51:31Z

I re-installed my Xcode command line developer tools
xcode-select --install
Now the Header directory is there, and I no longer any cblas.h errors.

Where do I find the proper coda to install for mxnet 1.1.0 for mac?
/Users/bradcarlile/mxnet/3rdparty/mshadow/mshadow/base.h:157:12: fatal error: 'cuda.h' file not
found
#include <cuda.h>
^~~~~~~~
error.

szha · 2018-04-06T00:53:21Z

Usually it's in /usr/local/cuda once CUDA is installed.

bradcar · 2018-04-06T01:00:07Z

THANKS!
what website do I go to download the proper CUDA for mac 10.13.4 and mxnet 1.1.0?

szha · 2018-04-06T01:44:38Z

That would be https://developer.nvidia.com/cuda-downloads

szha · 2018-04-06T01:45:03Z

and https://pypi.python.org/pypi?:action=display&name=mxnet-cu91&version=1.1.0

ThomasDelteil · 2018-07-30T21:54:51Z

Installation steps provided from this discussion have been made available on the mxnet website there:
http://mxnet.incubator.apache.org/install/index.html?platform=MacOS&language=Python&processor=GPU

@szha could you please close this issue?

szha added Call for Contribution Doc labels Jan 3, 2018

helloniklas mentioned this issue Jan 8, 2018

mac OS 10.13.2 and CUDA 8 marnovo/macOS-eGPU-CUDA-guide#5

Closed

aaronmarkham mentioned this issue Jan 9, 2018

added mac gpu install; refactored windows install #9353

Merged

5 tasks

szha closed this as completed Jul 30, 2018

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Installing GPU support on Mac #9217

Installing GPU support on Mac #9217

helloniklas commented Dec 28, 2017

szha commented Dec 28, 2017

helloniklas commented Dec 28, 2017

helloniklas commented Dec 28, 2017 •

edited

Loading

szha commented Dec 29, 2017

helloniklas commented Dec 31, 2017 •

edited

Loading

Cosmo commented Jan 3, 2018

helloniklas commented Jan 3, 2018 •

edited

Loading

Cosmo commented Jan 3, 2018

aaronmarkham commented Jan 8, 2018

aaronmarkham commented Jan 17, 2018

Cosmo commented Jan 17, 2018

aaronmarkham commented Jan 22, 2018

shankarrajus commented Jan 29, 2018

rafaelsimonmaia commented Feb 20, 2018

bradcar commented Apr 5, 2018

szha commented Apr 5, 2018

bradcar commented Apr 5, 2018 •

edited

Loading

szha commented Apr 5, 2018

bradcar commented Apr 5, 2018

szha commented Apr 5, 2018

szha commented Apr 5, 2018

bradcar commented Apr 5, 2018

szha commented Apr 5, 2018

bradcar commented Apr 5, 2018

bradcar commented Apr 6, 2018

szha commented Apr 6, 2018

bradcar commented Apr 6, 2018

szha commented Apr 6, 2018

szha commented Apr 6, 2018

ThomasDelteil commented Jul 30, 2018

Installing GPU support on Mac #9217

Installing GPU support on Mac #9217

Comments

helloniklas commented Dec 28, 2017

szha commented Dec 28, 2017

helloniklas commented Dec 28, 2017

helloniklas commented Dec 28, 2017 • edited Loading

szha commented Dec 29, 2017

helloniklas commented Dec 31, 2017 • edited Loading

Cosmo commented Jan 3, 2018

helloniklas commented Jan 3, 2018 • edited Loading

Cosmo commented Jan 3, 2018

aaronmarkham commented Jan 8, 2018

aaronmarkham commented Jan 17, 2018

Cosmo commented Jan 17, 2018

aaronmarkham commented Jan 22, 2018

shankarrajus commented Jan 29, 2018

rafaelsimonmaia commented Feb 20, 2018

bradcar commented Apr 5, 2018

szha commented Apr 5, 2018

bradcar commented Apr 5, 2018 • edited Loading

szha commented Apr 5, 2018

bradcar commented Apr 5, 2018

szha commented Apr 5, 2018

szha commented Apr 5, 2018

bradcar commented Apr 5, 2018

szha commented Apr 5, 2018

bradcar commented Apr 5, 2018

bradcar commented Apr 6, 2018

szha commented Apr 6, 2018

bradcar commented Apr 6, 2018

szha commented Apr 6, 2018

szha commented Apr 6, 2018

ThomasDelteil commented Jul 30, 2018

helloniklas commented Dec 28, 2017 •

edited

Loading

helloniklas commented Dec 31, 2017 •

edited

Loading

helloniklas commented Jan 3, 2018 •

edited

Loading

bradcar commented Apr 5, 2018 •

edited

Loading