Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

why the fcnTrain.m running so slow? #25

Closed
brisker opened this issue Apr 12, 2016 · 4 comments
Closed

why the fcnTrain.m running so slow? #25

brisker opened this issue Apr 12, 2016 · 4 comments

Comments

@brisker
Copy link

brisker commented Apr 12, 2016

Is it because the DriverVersion and the ToolkitVersion not matched?
How to solve this problem? Please help me,thank you!
CUDADevice with properties:

                  Name: 'GeForce GTX TITAN X'
                 Index: 1
     ComputeCapability: '5.2'
        SupportsDouble: 1
         DriverVersion: 7.5000
        ToolkitVersion: 6.5000
    MaxThreadsPerBlock: 1024
      MaxShmemPerBlock: 49152
    MaxThreadBlockSize: [1024 1024 64]
           MaxGridSize: [2.1475e+09 65535 65535]
             SIMDWidth: 32
           TotalMemory: 1.2885e+10
       AvailableMemory: 1.2609e+10
   MultiprocessorCount: 24
          ClockRateKHz: 1076000
           ComputeMode: 'Default'
  GPUOverlapsTransfers: 1
KernelExecutionTimeout: 1
      CanMapHostMemory: 1
       DeviceSupported: 1
        DeviceSelected: 1

train: epoch 01: 1/565: 0.9 Hz accuracy: 0.677 0.048 0.032 objective: 3.044
train: epoch 01: 2/565: 1.0 Hz accuracy: 0.691 0.048 0.033 objective: 3.035
train: epoch 01: 3/565: 1.0 Hz accuracy: 0.698 0.048 0.033 objective: 2.994

@brisker brisker changed the title Why the gpu frequency only 1Hz? Is it because the DriverVersion and the ToolkitVersion not matched? why the fcnTrain.m running so slow? Apr 12, 2016
@mjohn123
Copy link

Hello, I think that you did not active GPU mode. Find and change opts.train.gpus = [] to opts.train.gpus = 1 . It needs more than 5GB GPU

@brisker
Copy link
Author

brisker commented Apr 18, 2016

@mjohn123
In fcnTrain I haven't found opts.train.gpus = []
only like this:
% training options (SGD)
opts.train = struct([]) ;
[opts, varargin] = vl_argparse(opts, varargin) ;

trainOpts.batchSize = 20 ;

trainOpts.numSubBatches = 10 ;

trainOpts.continue = true ;
% trainOpts.gpus = [1,2,3,4] ;
% trainOpts.gpus = [1] ;
trainOpts.gpus = [2] ;
trainOpts.prefetch = true ;
trainOpts.expDir = opts.expDir ;
trainOpts.learningRate = 0.0001 * ones(1,50) ;

trainOpts.numEpochs = numel(trainOpts.learningRate) ;

@brisker
Copy link
Author

brisker commented Apr 18, 2016

@mjohn123 "opts.train.gpus = 1" or "opts.train.gpus = [1]" ??

@mjohn123
Copy link

Let read that issue and do it. It worked

#17

@brisker brisker closed this as completed Apr 1, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants