Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Code obsolescence #11

Open
BauTsAnD opened this issue Mar 4, 2024 · 2 comments
Open

Code obsolescence #11

BauTsAnD opened this issue Mar 4, 2024 · 2 comments

Comments

@BauTsAnD
Copy link

BauTsAnD commented Mar 4, 2024

Code is becoming obsolete in new versions of Python and Google colab
The problems are slowness and incompatibility in Google colab with the GPU

@deton24
Copy link

deton24 commented Mar 6, 2024

Make a new cell with:
!apt-get install cuda-11-8
added after installation cell, and separation time is fixed.
But executing it will take 8 minutes.

For some reason, faster
!pip3 install ort-nightly-gpu --index-url=https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ort-cuda-12-nightly/pypi/simple/
or
!python -m pip install ort-nightly-gpu --index-url=https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/ort-cuda-12-nightly/pypi/simple/
doesn't fix the issue like in other MDX-Net or MDX23C Colabs. The GUI behaves, like it wasn't using it at all.

@deton24
Copy link

deton24 commented Mar 6, 2024

No need to wait 8 minutes anymore. They released official non-nightly onnxruntime-cuda-12 package, and it's compatible with KaraFan (contrary to the nightly package).

Use this Colab with the fix:
https://colab.research.google.com/github/Eddycrack864/KaraFan/blob/master/KaraFan_Improved_Version.ipynb (with new models)

Or:
Click on the first hidden line, find the last line of the code, go to the end of it (set cursor on the left of "(1)" ), press enter, and in the next line with the space added automatically on the left before the empty line when you pressed enter, paste:
!pip install onnxruntime-gpu --extra-index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/_packaging/onnxruntime-cuda-12/pypi/simple/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants