We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Currently the live Demo runs out of memory when trying to run the latest model (M3.1).
This model will work locally on most devices, the model is too large currently for the live Demo which only has 500mb of memory.
The text was updated successfully, but these errors were encountered:
This will be fixed later in the week when the M3.1s model is released, which is identical to the M3.1 model but quantized to be run more efficiently.
🏷️ This will happen under the 3.1.1 tag.
Sorry, something went wrong.
Will be fixed in 3.2 along side some model architecture changes
Thomasbehan
When branches are created from issues, their pull requests are automatically linked.
Currently the live Demo runs out of memory when trying to run the latest model (M3.1).
This model will work locally on most devices, the model is too large currently for the live Demo which only has 500mb of memory.
![Screenshot_20240604_110701_Gmail.jpg](https://private-user-images.githubusercontent.com/8860273/336406028-86ebb5f9-9edd-4821-9168-8dac17eadb95.jpg?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjE1NTU3NjgsIm5iZiI6MTcyMTU1NTQ2OCwicGF0aCI6Ii84ODYwMjczLzMzNjQwNjAyOC04NmViYjVmOS05ZWRkLTQ4MjEtOTE2OC04ZGFjMTdlYWRiOTUuanBnP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDcyMSUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA3MjFUMDk1MTA4WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9Zjc5ODY4YmJiMzMxM2RmYTVhMWIyMzgzYmZhMjVhODc1YWFiODFhNDIwNzM5YWI4NGE3OTA2NGNkOGViMDFmOCZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.Eh0oJVHEwjww7zYEUTeKtE_JnM1IXgLRx3r9U8syMDM)
The text was updated successfully, but these errors were encountered: