-
Notifications
You must be signed in to change notification settings - Fork 149
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
IndexError: tensors used as indices must be long, byte or bool tensors (Retinanet only) #547
Comments
Strangely, on rerunning |
Still seen on |
It's the first time I see this error, I have to admit I have no clue on what it might be... I'll run the notebook you shared and investigate further You used the same code to train faster_rcnn and efficientdet without problems right? |
|
Have rerun my notebook on
UPDATE: this was a separate issue that was introduced and then resolved separately |
For future reference, we're addressing this in: https://discord.com/channels/735877944085446747/780951889025564692/784409448017952808 |
OK installed from master and now on |
If you're running this on a notebook, when you get the error can you try invoking a debugger with
|
I get:
The training does not look correct at all |
So the loss is exploding here, might be related. What happens if you run with a much smaller learning rate? Like |
And now the loss isn't exploding as well =x Any new insights on what might be happening? |
Error persists in |
Alright on |
@robmarkcole may have to do with the |
Thanks @rsomani95 will close this then |
🐛 Bug
Describe the bug
On icevision 0.4.0, running retinanet on custom dataset (fire) I get the following:
To Reproduce
Steps to reproduce the behavior:
Has happened during
learn.lr_find()
, but on another occasion I passed this point and got error duringlearn.fine_tune(50, 3e-3, freeze_epochs=1)
. I placed the notebook at https://github.com/robmarkcole/fire-detection-from-images/blob/master/pytorch/icevision/icevision_firenet_retinanet.ipynbExpected behavior
No error
Screenshots
NA
Desktop (please complete the following information):
Additional context
None
The text was updated successfully, but these errors were encountered: