Skip to content
This repository has been archived by the owner on Mar 19, 2024. It is now read-only.

quantize only seems to use 1 core? #353

Closed
dcsan opened this issue Nov 6, 2017 · 3 comments
Closed

quantize only seems to use 1 core? #353

dcsan opened this issue Nov 6, 2017 · 3 comments

Comments

@dcsan
Copy link

dcsan commented Nov 6, 2017

I'm using quantize with -thread 12 argument and the process only seems to use one core (ubuntu 16.0.4)

are there any other ways to speed up the process?
I'm guessing thread is an internal C thread, but should that be able to use > 1 core?

fasttext quantize \
    -output "${MODEL_FILE}" \
    -input "${LABEL_FILE}" \
    -dim 300 \
    -loss softmax \
    -qnorm \
    -thread 12 \
    -epoch 1

image

@EdouardGrave
Copy link
Contributor

Hi @dcsan,

As of now, the quantization of models is not multi-threaded, and there are no ways to speed up the process.

Best,
Edouard.

@dcsan
Copy link
Author

dcsan commented Nov 7, 2017

thanks for response! closing.

@dcsan dcsan closed this as completed Nov 7, 2017
@rmc135
Copy link

rmc135 commented Aug 14, 2020

A further 'gotcha' is that autotuned training with the -autotune-modelsize option will invoke quantization, so the entire run will quietly switch to using a single core only. It took me a while to figure this out. Perhaps the documentation could be updated to warn of this.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants