We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Databricks has released DBRX, which consists of 2 models
It's a 132B parameter MoE model. Might be useful.
No response
It seems that they have a custom script in their files, might need custom implementation on that regard.
The text was updated successfully, but these errors were encountered:
We just added a PR: #3660 Thanks @megha95 !
Sorry, something went wrong.
Successfully merging a pull request may close this issue.
The model to consider.
Databricks has released DBRX, which consists of 2 models
It's a 132B parameter MoE model. Might be useful.
The closest model vllm already supports.
No response
What's your difficulty of supporting the model you want?
It seems that they have a custom script in their files, might need custom implementation on that regard.
The text was updated successfully, but these errors were encountered: