You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thanks for releasing your great work. I was wondering if there is a way to run the finetuning and zero-shot inference code on GPU rather than TPU? What king of adjustment would I need to make?
Thanks
The text was updated successfully, but these errors were encountered:
It should be possible. The big differences might be removing the "bfloat16" casting (as that's a datatype specific to TPUs), and changing some of the boilerplate code to not be TPU specific.
I'm also trying to run the model on GPU, but the model checkpoint is in bfloat16.
Thus I'm trying to load the model first with bfloat16's, and then cast everything back to float32's, but am encountering various problems.
I'm wondering if you have resolved this issue somehow?
Thanks for releasing your great work. I was wondering if there is a way to run the finetuning and zero-shot inference code on GPU rather than TPU? What king of adjustment would I need to make?
Thanks
The text was updated successfully, but these errors were encountered: