half precision not supported by CPU?

[wolfshow]

cannot run the CPU code now.

[levyfan]

Half precision is not supported by CPU. MKL does not have such half precision BLAS methods.

[wolfshow]

Half precision is not supported by CPU. MKL does not have such half precision BLAS methods.

how to modify the code to be used with CPU?

[levyfan]

Half precision is not supported by CPU. MKL does not have such half precision BLAS methods.

how to modify the code to be used with CPU?

Could you clarify your question? I am not sure what you are asking.

For running on CPU, only single precision (float) is supported. The reason of no half precision is lying on Intel's MKL. They do not support half precision computing. There is nothing we can do now.

[wolfshow]

For running on CPU, only single precision (float) is supported. The reason of no half precision is lying on Intel's MKL. They do not support half precision computing. There is nothing we can do now.

When I compile the current code base and run the ”cuBERT_benchmark“, I got the error "half precision not supported by CPU". My question is, how to modify the code and make it runnable on CPU? I only need single precision computing.

[levyfan]

You can simply change

cuBERT/benchmark/benchmark_cu.cpp

Line 8 in 8ab0384

typedef half_float::half Dtype;

to typedef float Dtype;

and change

cuBERT/benchmark/benchmark_cu.cpp

Line 11 in 8ab0384

cuBERT_ComputeType compute_type = cuBERT_COMPUTE_HALF;

to cuBERT_ComputeType compute_type = cuBERT_COMPUTE_FLOAT;

[levyfan]

If you would like to run your own model, you may also need to give

cuBERT/benchmark/benchmark_cu.cpp

Line 39 in 8ab0384

Dtype logits[batch_size];

more memory space and change output_type from cuBERT_LOGITS to your own model.

[wolfshow]

If you would like to run your own model, you may also need to give

cuBERT/benchmark/benchmark_cu.cpp

Line 39 in 8ab0384

Dtype logits[batch_size];

more memory space and change output_type from cuBERT_LOGITS to your own model.

Thanks a lot!