You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello, I wrote a project which uses rust-bert. However, I noticed that loading the same model in python uses 1/2 of what my rust implementation uses even when I only load once. Any idea how to fix this? Any help would be appreciated. Thanks!
Extract from nvidia-smi (Python)
+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
| 0 N/A N/A 726 G /usr/lib/Xorg 518MiB |
| 0 N/A N/A 1796 G ...,WinRetrieveSuggestionsOnlyOnDemand 75MiB |
| 0 N/A N/A 2333 G ...re/Steam/ubuntu12_64/steamwebhelper 7MiB |
| 0 N/A N/A 3586 G /usr/lib/firefox/firefox 194MiB |
| 0 N/A N/A 6787 G ...sion,SpareRendererForSitePerProcess 352MiB |
| 0 N/A N/A 15763 G ...--disable-features=BackForwardCache 93MiB |
| 0 N/A N/A 79356 G alacritty 9MiB |
| 0 N/A N/A 86867 C ...envs/langchain-templates/bin/python 1448MiB |
+---------------------------------------------------------------------------------------+
Extract from nvidia-smi (Rust)
+---------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=======================================================================================|
| 0 N/A N/A 726 G /usr/lib/Xorg 518MiB |
| 0 N/A N/A 1796 G ...,WinRetrieveSuggestionsOnlyOnDemand 75MiB |
| 0 N/A N/A 2333 G ...re/Steam/ubuntu12_64/steamwebhelper 7MiB |
| 0 N/A N/A 3586 G /usr/lib/firefox/firefox 194MiB |
| 0 N/A N/A 6787 G ...sion,SpareRendererForSitePerProcess 328MiB |
| 0 N/A N/A 15763 G ...--disable-features=BackForwardCache 93MiB |
| 0 N/A N/A 79356 G alacritty 9MiB |
| 0 N/A N/A 86607 C target/release/axum-t5-embeddings 2830MiB |
+---------------------------------------------------------------------------------------+
The text was updated successfully, but these errors were encountered:
Hello, I wrote a project which uses rust-bert. However, I noticed that loading the same model in python uses 1/2 of what my rust implementation uses even when I only load once. Any idea how to fix this? Any help would be appreciated. Thanks!
Extract from nvidia-smi (Python)
Extract from nvidia-smi (Rust)
The text was updated successfully, but these errors were encountered: