We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
eps
Mistral3RMSNorm
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
The class Mistral3RMSNorm can receive eps:
transformers/src/transformers/models/mistral3/modeling_mistral3.py
Line 49 in f2909e0
but when used in the creation of the Mistral3 model, it is not actually passed
Line 109 in f2909e0
It could be solved as follows:
self.norm = Mistral3RMSNorm(config.vision_config.hidden_size, eps=config.text_config.rms_norm_eps)
The text was updated successfully, but these errors were encountered:
Successfully merging a pull request may close this issue.
The class
Mistral3RMSNorm
can receiveeps
:transformers/src/transformers/models/mistral3/modeling_mistral3.py
Line 49 in f2909e0
but when used in the creation of the Mistral3 model, it is not actually passed
transformers/src/transformers/models/mistral3/modeling_mistral3.py
Line 109 in f2909e0
It could be solved as follows:
The text was updated successfully, but these errors were encountered: