Multithreadding Vulture operator for NER produces a race condition

[ryancb4]

No description provided.

[MaksimEkin]

I disagree

[ryancb4]

Solution for NER race condition:

Use parallel_backend=multiprocessing Vulture parameter and initialize the script with:

import os
os.environ["OMP_NUM_THREADS"] = "1" # export OMP_NUM_THREADS=1
os.environ["OPENBLAS_NUM_THREADS"] = "1" # export OPENBLAS_NUM_THREADS=1
os.environ["MKL_NUM_THREADS"] = "1" # export MKL_NUM_THREADS=1
os.environ["VECLIB_MAXIMUM_THREADS"] = "1" # export VECLIB_MAXIMUM_THREADS=1
os.environ["NUMEXPR_NUM_THREADS"] = "1" # export NUMEXPR_NUM_THREADS=1