Skip to content

Use accurate softmax#414

Merged
pxl-th merged 2 commits intomasterfrom
pxl-th/softmax
Apr 20, 2023
Merged

Use accurate softmax#414
pxl-th merged 2 commits intomasterfrom
pxl-th/softmax

Conversation

@pxl-th
Copy link
Copy Markdown
Member

@pxl-th pxl-th commented Apr 20, 2023

Fast softmax produces NaN values in FP16 mode on big arrays (e.g. 4096x4096)...

@pxl-th pxl-th merged commit 9e13ee6 into master Apr 20, 2023
@pxl-th pxl-th deleted the pxl-th/softmax branch April 20, 2023 11:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant