easynmt/api:2.0-cuda11.1 doesn't seem to use my GPU

[JohnWinner]

Just got a new CentOS 7 server with a GeForce RTX 2080 GPU...

• using "nvidia-smi" I could see my card
• installed docker
• started new easynmt instance with "docker run -d --name easynmt --restart always -v /easynmt_cache:/cache -p 24080:80 easynmt/api:2.0-cuda11.1"

Using the API the translation was very slow so I tried the following:

• docker exec -it easynmt bash
• installed curl
• downloaded the test_translation_speed.py
• ran "python translation_speed.py opus-mt"
• I only got 5.29 sentences/s
• I tried the following: torch.cuda.is_available() and it returned False

Correct me if I am wrong but it seems like my easynmt instance doesn't use the GPU? Did I do something wrong?

Thank you for your help...

[nreimers]

You must setup docker so that it can access the GPUs
https://docs.docker.com/config/containers/resource_constraints/#gpu

[JohnWinner]

Worked!
I got 46.93 sentences/second! Super!
Thanks a lot!