Getting Loss : nan while fine-tuning blip2-opt-2.7b

[tan7vir]

I am using this code to fine-tuning model but get nan loss value and the model give strange output.

My Fine-tuning code.

And getting output like this:

[amyeroberts]

Hi @tan7vir, thanks for raising an issue!

This is a question best placed in our forums. We try to reserve the github issues for feature requests and bug reports.

[tan7vir]

@amyeroberts Thank You.