Skip to content

Fixing inference api for FP32 and non-masking GPT-based models#1204

Merged
jeffra merged 6 commits intomasterfrom
reyazda/fix-inference-api
Jul 20, 2021
Merged

Fixing inference api for FP32 and non-masking GPT-based models#1204
jeffra merged 6 commits intomasterfrom
reyazda/fix-inference-api

Conversation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Inference with replace_method='auto' fails for gpt2-xl generation

2 participants