python bert package is missing

[nturenne]

i would like to use golgotha to run Bert for classification task
but i get an error after installing and when running

transformer_download_model("bert-base-multilingual-uncased")
Downloading model to C:/Program Files/R/R-4.0.3/library/golgotha/models/bert-base-multilingual-uncased
Erreur : Python module BERT was not found.

perhaps you can help me to solve this

thk u
nicolas

[jwijffels]

Looks similar to rstudio/reticulate#740
The user there also had a 'Python module BERT was not found' issue.
Maybe have a look there.

[nturenne]

thank you for pointer, indeed very similar case
i tried to install a new environnment using reticulate
conda_install("r-reticulate", "pytorch")
conda_install("r-reticulate", "transformers")

i get still the same error
any idea about which module of python i need to install ?

thank you

[jwijffels]

See the bottom of the README

[nturenne]

below is the trace , i follow the instruction , install gives no error
i dont understand

conda_install(envname = 'r-reticulate', c('torch', 'transformers'), pip = TRUE)
Requirement already satisfied: torch in d:\utilisateurs\turenne\appdata\local\r-miniconda\envs\r-reticulate\lib\site-packages (1.6.0)
Requirement already satisfied: transformers in d:\utilisateurs\turenne\appdata\local\r-miniconda\envs\r-reticulate\lib\site-packages (4.0.1)
Collecting torch
Downloading torch-1.7.1-cp38-cp38-win_amd64.whl (184.0 MB)
Requirement already satisfied: numpy in d:\utilisateurs\turenne\appdata\local\r-miniconda\envs\r-reticulate\lib\site-packages (from torch) (1.19.4)
Collecting transformers
Downloading transformers-4.1.1-py3-none-any.whl (1.5 MB)
Requirement already satisfied: tokenizers==0.9.4 in d:\utilisateurs\turenne\appdata\local\r-miniconda\envs\r-reticulate\lib\site-packages (from transformers) (0.9.4)
Requirement already satisfied: tqdm>=4.27 in d:\utilisateurs\turenne\appdata\local\r-miniconda\envs\r-reticulate\lib\site-packages (from transformers) (4.54.1)
Requirement already satisfied: sacremoses in d:\utilisateurs\turenne\appdata\local\r-miniconda\envs\r-reticulate\lib\site-packages (from transformers) (0.0.43)
Requirement already satisfied: filelock in d:\utilisateurs\turenne\appdata\local\r-miniconda\envs\r-reticulate\lib\site-packages (from transformers) (3.0.12)
Requirement already satisfied: packaging in d:\utilisateurs\turenne\appdata\local\r-miniconda\envs\r-reticulate\lib\site-packages (from transformers) (20.8)
Requirement already satisfied: requests in d:\utilisateurs\turenne\appdata\local\r-miniconda\envs\r-reticulate\lib\site-packages (from transformers) (2.25.1)
Requirement already satisfied: regex!=2019.12.17 in d:\utilisateurs\turenne\appdata\local\r-miniconda\envs\r-reticulate\lib\site-packages (from transformers) (2020.11.13)
Requirement already satisfied: pyparsing>=2.0.2 in d:\utilisateurs\turenne\appdata\local\r-miniconda\envs\r-reticulate\lib\site-packages (from packaging->transformers) (2.4.7)
Requirement already satisfied: chardet<5,>=3.0.2 in d:\utilisateurs\turenne\appdata\local\r-miniconda\envs\r-reticulate\lib\site-packages (from requests->transformers) (4.0.0)
Requirement already satisfied: idna<3,>=2.5 in d:\utilisateurs\turenne\appdata\local\r-miniconda\envs\r-reticulate\lib\site-packages (from requests->transformers) (2.10)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in d:\utilisateurs\turenne\appdata\local\r-miniconda\envs\r-reticulate\lib\site-packages (from requests->transformers) (1.26.2)
Requirement already satisfied: certifi>=2017.4.17 in d:\utilisateurs\turenne\appdata\local\r-miniconda\envs\r-reticulate\lib\site-packages (from requests->transformers) (2020.12.5)
Requirement already satisfied: click in d:\utilisateurs\turenne\appdata\local\r-miniconda\envs\r-reticulate\lib\site-packages (from sacremoses->transformers) (7.1.2)
Requirement already satisfied: joblib in d:\utilisateurs\turenne\appdata\local\r-miniconda\envs\r-reticulate\lib\site-packages (from sacremoses->transformers) (1.0.0)
Requirement already satisfied: six in d:\utilisateurs\turenne\appdata\local\r-miniconda\envs\r-reticulate\lib\site-packages (from sacremoses->transformers) (1.15.0)
Collecting typing-extensions
Downloading typing_extensions-3.7.4.3-py3-none-any.whl (22 kB)
Installing collected packages: typing-extensions, transformers, torch
Attempting uninstall: transformers
Found existing installation: transformers 4.0.1
Uninstalling transformers-4.0.1:
Successfully uninstalled transformers-4.0.1
WARNING: The script transformers-cli.exe is installed in 'D:\UTILIS1\turenne\AppData\Local\R-MINI1\envs\R-RETI1\Scripts' which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
Attempting uninstall: torch
Found existing installation: torch 1.6.0
Uninstalling torch-1.6.0:
Successfully uninstalled torch-1.6.0
WARNING: The scripts convert-caffe2-to-onnx.exe and convert-onnx-to-caffe2.exe are installed in 'D:\UTILIS1\turenne\AppData\Local\R-MINI1\envs\R-RETI1\Scripts' which is not on PATH.
Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location.
Successfully installed torch-1.7.1 transformers-4.1.1 typing-extensions-3.7.4.3
[1] "torch" "transformers"
library(golgotha)
transformer_download_model("bert-base-multilingual-uncased")
Downloading model to C:/Program Files/R/R-4.0.3/library/golgotha/models/bert-base-multilingual-uncased
Erreur : Python module BERT was not found.

Detected Python configuration:

python: D:/Utilisateurs/turenne/AppData/Local/r-miniconda/envs/r-reticulate/python.exe
libpython: D:/Utilisateurs/turenne/AppData/Local/r-miniconda/envs/r-reticulate/python36.dll
pythonhome: D:/Utilisateurs/turenne/AppData/Local/r-miniconda/envs/r-reticulate
version: 3.6.10 |Anaconda, Inc.| (default, Jan 7 2020, 15:18:16) [MSC v.1916 64 bit (AMD64)]
Architecture: 64bit
numpy: D:/Utilisateurs/turenne/AppData/Local/r-miniconda/envs/r-reticulate/Lib/site-packages/numpy
numpy_version: 1.18.1

[jwijffels]

I think you should ask this at the reticulate package while copying the full installation trace alongside the golgotha DESCRIPTION file namely https://github.com/bnosac/golgotha/blob/master/DESCRIPTION#L25 which shows the package requirements.
Seems to me to be the exact same issue as at rstudio/reticulate#740