Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

馃毃 test(integration): validate MultiHeadAttention & fix Softmax stability #70

Merged
merged 5 commits into from
Mar 12, 2023

Conversation

jean-francoisreboud
Copy link
Collaborator

Changes:

  • validate MultiHeadAttention with a PyTorch model
  • fix Softmax numeric stability

@jean-francoisreboud jean-francoisreboud merged commit e4ef332 into release_4 Mar 12, 2023
@jean-francoisreboud jean-francoisreboud deleted the jfr/test branch March 12, 2023 09:27
@jean-francoisreboud jean-francoisreboud mentioned this pull request Aug 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant