New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Possibility for a Mixture-of-Experts Model? #9

Closed

elmstedt opened this issue Dec 13, 2023 · 1 comment

Assignees

Labels

discussion

elmstedt commented Dec 13, 2023

With the recent release of Mixtral 8x7B, there's a lot of hope and excitement around open-source MoE models.

It would be very interesting to see how a narrowly focused MoE model performs.

Member

UniverseFly commented Dec 15, 2023

Yes, this is truly interesting and what we will try in the future!!

UniverseFly closed this as completed

UniverseFly added the discussion label

UniverseFly self-assigned this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment