Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Live Demo Memory Issues #46

Open
Thomasbehan opened this issue Jun 4, 2024 · 2 comments
Open

Live Demo Memory Issues #46

Thomasbehan opened this issue Jun 4, 2024 · 2 comments
Assignees
Labels
bug Something isn't working Deployment Deployment Related Model AI Model Related

Comments

@Thomasbehan
Copy link
Owner

Thomasbehan commented Jun 4, 2024

Currently the live Demo runs out of memory when trying to run the latest model (M3.1).

This model will work locally on most devices, the model is too large currently for the live Demo which only has 500mb of memory.
Screenshot_20240604_110701_Gmail.jpg

@Thomasbehan Thomasbehan added bug Something isn't working Deployment Deployment Related Model AI Model Related labels Jun 4, 2024
@Thomasbehan
Copy link
Owner Author

This will be fixed later in the week when the M3.1s model is released, which is identical to the M3.1 model but quantized to be run more efficiently.

🏷️ This will happen under the 3.1.1 tag.

@Thomasbehan Thomasbehan self-assigned this Jun 10, 2024
@Thomasbehan
Copy link
Owner Author

Will be fixed in 3.2 along side some model architecture changes

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Deployment Deployment Related Model AI Model Related
Projects
Status: Training Model
Development

When branches are created from issues, their pull requests are automatically linked.

1 participant