Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Gradient of Parameter ssd1_batchnorm0_beta on context gpu(0) has not been updated by backward since last step #51

Open
mahin003 opened this issue Oct 22, 2020 · 3 comments

Comments

@mahin003
Copy link

I'm trying to execute the code as it is .. but i dont know why i'm getting this error ..
"UserWarning: Gradient of Parameter ssd1_batchnorm0_beta on context gpu(0) has not been updated by backward since last step. This could mean a bug in your model that made it only use a subset of the Parameters (Blocks) for this iteration. If you are intentionally only using a subset, call step with ignore_stale_grad=True to suppress this warning and skip updating of Parameters with stale gradient " on trainer.step(stepsize)

@jonomon
Copy link
Contributor

jonomon commented Oct 27, 2020

I tried to run word_and_line_segmentation.py end to end and I did not see the error.

  1. Would it be possible to post the exact arguments you used?
  2. Could you confirm that this line ran correctly?

@mahin003
Copy link
Author

thanks for your response sir ... i have solved this issue .. i reduced the batch size from 32 to 20 .. i don't know why(i'm new in mxnet) but that was the reason ..
and Sir in IAMdataset there are 1500+ images but why only 967 data for training and 232 data for testing was used?? and how can i increase the training dataset number .
sir, i am a Bangladeshi student and currently doing my undergraduate thesis , my topic is "Bangla handwritten ocr system " , from page to word level segmentation i'm following (implementing) your system which i did , i ran the "line_word_segmentation" notebook for word segmentation and set epoch 400 .. but its not detecting word segments properly . how many epoch should i set for word segmentation ? and sir, " mahinqureship1@gmail.com " this is my email . it will be a great help for me if i could contact you through mail .

@jonomon
Copy link
Contributor

jonomon commented Oct 28, 2020

The IAM dataset has train, validation and test data. We did not use the validation data for training nor testing.

We set the number of epochs to 400 for word segmentation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants