You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Using the docker container to run eland_import_hub_model and install a large model imposes large memory requirements. For example using the command below to install xlm-roberta-base requires the container to have more than 8GB of memory.
If the container does not have enough memory the process exits shortly after the download has completed prior to uploading the model to Elasticsearch. Investigate the what is causing the high memory usage.
What is causing the high memory usage?
Tracing the mode?
How can a failure due to insufficient memory be detected and reported?
The text was updated successfully, but these errors were encountered:
davidkyle
changed the title
[Import Model] High transient memory usage when installing large models
[Import Model] High transient memory usage when installing large models with Docker
Aug 24, 2023
Using the docker container to run
eland_import_hub_model
and install a large model imposes large memory requirements. For example using the command below to install xlm-roberta-base requires the container to have more than 8GB of memory.If the container does not have enough memory the process exits shortly after the download has completed prior to uploading the model to Elasticsearch. Investigate the what is causing the high memory usage.
The text was updated successfully, but these errors were encountered: