Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issues with pretrained weights #12

Closed
jgsch opened this issue Mar 3, 2020 · 2 comments
Closed

Issues with pretrained weights #12

jgsch opened this issue Mar 3, 2020 · 2 comments

Comments

@jgsch
Copy link

jgsch commented Mar 3, 2020

  • Dimensions mismatch
Config '/opt/detectron2/projects/CenterMask2/configs/centermask/centermask_lite_V_19_slim_dw_eSE_FPN_ms_4x.yaml' has no VERSION. 
Assuming it to be compatible with latest v2.

Pretrained weights on coco dataset found 
(at `https://dl.dropbox.com/s/tczecsdxt10uai5/vsvhwtqm6ko1c7m/centermask-lite-V-19-eSE-slim-dw-FPN-ms-4x.pth`).
'backbone.fpn_lateral3.weight' has shape (256, 512, 1, 1) in the checkpoint but (128, 256, 1, 1) in the model! Skipped.
'backbone.fpn_lateral3.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'backbone.fpn_output3.weight' has shape (256, 256, 3, 3) in the checkpoint but (128, 128, 3, 3) in the model! Skipped.
'backbone.fpn_output3.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'backbone.fpn_lateral4.weight' has shape (256, 768, 1, 1) in the checkpoint but (128, 384, 1, 1) in the model! Skipped.
'backbone.fpn_lateral4.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'backbone.fpn_output4.weight' has shape (256, 256, 3, 3) in the checkpoint but (128, 128, 3, 3) in the model! Skipped.
'backbone.fpn_output4.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'backbone.fpn_lateral5.weight' has shape (256, 1024, 1, 1) in the checkpoint but (128, 512, 1, 1) in the model! Skipped.
'backbone.fpn_lateral5.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'backbone.fpn_output5.weight' has shape (256, 256, 3, 3) in the checkpoint but (128, 128, 3, 3) in the model! Skipped.
'backbone.fpn_output5.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'backbone.top_block.p6.weight' has shape (256, 256, 3, 3) in the checkpoint but (128, 128, 3, 3) in the model! Skipped.
'backbone.top_block.p6.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'backbone.top_block.p7.weight' has shape (256, 256, 3, 3) in the checkpoint but (128, 128, 3, 3) in the model! Skipped.
'backbone.top_block.p7.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'backbone.bottom_up.stage2.OSA2_1.concat.OSA2_1_concat/conv.weight' has shape (256, 768, 1, 1) in the checkpoint but (112, 256, 1, 1) in the model! Skipped.
'backbone.bottom_up.stage2.OSA2_1.concat.OSA2_1_concat/norm.weight' has shape (256,) in the checkpoint but (112,) in the model! Skipped.
'backbone.bottom_up.stage2.OSA2_1.concat.OSA2_1_concat/norm.bias' has shape (256,) in the checkpoint but (112,) in the model! Skipped.
'backbone.bottom_up.stage2.OSA2_1.concat.OSA2_1_concat/norm.running_mean' has shape (256,) in the checkpoint but (112,) in the model! Skipped.
'backbone.bottom_up.stage2.OSA2_1.concat.OSA2_1_concat/norm.running_var' has shape (256,) in the checkpoint but (112,) in the model! Skipped.
'backbone.bottom_up.stage2.OSA2_1.ese.fc.weight' has shape (256, 256, 1, 1) in the checkpoint but (112, 112, 1, 1) in the model! Skipped.
'backbone.bottom_up.stage2.OSA2_1.ese.fc.bias' has shape (256,) in the checkpoint but (112,) in the model! Skipped.
'backbone.bottom_up.stage3.OSA3_1.concat.OSA3_1_concat/conv.weight' has shape (512, 1056, 1, 1) in the checkpoint but (256, 352, 1, 1) in the model! Skipped.
'backbone.bottom_up.stage3.OSA3_1.concat.OSA3_1_concat/norm.weight' has shape (512,) in the checkpoint but (256,) in the model! Skipped.
'backbone.bottom_up.stage3.OSA3_1.concat.OSA3_1_concat/norm.bias' has shape (512,) in the checkpoint but (256,) in the model! Skipped.
'backbone.bottom_up.stage3.OSA3_1.concat.OSA3_1_concat/norm.running_mean' has shape (512,) in the checkpoint but (256,) in the model! Skipped.
'backbone.bottom_up.stage3.OSA3_1.concat.OSA3_1_concat/norm.running_var' has shape (512,) in the checkpoint but (256,) in the model! Skipped.
'backbone.bottom_up.stage3.OSA3_1.ese.fc.weight' has shape (512, 512, 1, 1) in the checkpoint but (256, 256, 1, 1) in the model! Skipped.
'backbone.bottom_up.stage3.OSA3_1.ese.fc.bias' has shape (512,) in the checkpoint but (256,) in the model! Skipped.
'backbone.bottom_up.stage4.OSA4_1.concat.OSA4_1_concat/conv.weight' has shape (768, 1472, 1, 1) in the checkpoint but (384, 544, 1, 1) in the model! Skipped.
'backbone.bottom_up.stage4.OSA4_1.concat.OSA4_1_concat/norm.weight' has shape (768,) in the checkpoint but (384,) in the model! Skipped.
'backbone.bottom_up.stage4.OSA4_1.concat.OSA4_1_concat/norm.bias' has shape (768,) in the checkpoint but (384,) in the model! Skipped.
'backbone.bottom_up.stage4.OSA4_1.concat.OSA4_1_concat/norm.running_mean' has shape (768,) in the checkpoint but (384,) in the model! Skipped.
'backbone.bottom_up.stage4.OSA4_1.concat.OSA4_1_concat/norm.running_var' has shape (768,) in the checkpoint but (384,) in the model! Skipped.
'backbone.bottom_up.stage4.OSA4_1.ese.fc.weight' has shape (768, 768, 1, 1) in the checkpoint but (384, 384, 1, 1) in the model! Skipped.
'backbone.bottom_up.stage4.OSA4_1.ese.fc.bias' has shape (768,) in the checkpoint but (384,) in the model! Skipped.
'backbone.bottom_up.stage5.OSA5_1.concat.OSA5_1_concat/conv.weight' has shape (1024, 1888, 1, 1) in the checkpoint but (512, 720, 1, 1) in the model! Skipped.
'backbone.bottom_up.stage5.OSA5_1.concat.OSA5_1_concat/norm.weight' has shape (1024,) in the checkpoint but (512,) in the model! Skipped.
'backbone.bottom_up.stage5.OSA5_1.concat.OSA5_1_concat/norm.bias' has shape (1024,) in the checkpoint but (512,) in the model! Skipped.
'backbone.bottom_up.stage5.OSA5_1.concat.OSA5_1_concat/norm.running_mean' has shape (1024,) in the checkpoint but (512,) in the model! Skipped.
'backbone.bottom_up.stage5.OSA5_1.concat.OSA5_1_concat/norm.running_var' has shape (1024,) in the checkpoint but (512,) in the model! Skipped.
'backbone.bottom_up.stage5.OSA5_1.ese.fc.weight' has shape (1024, 1024, 1, 1) in the checkpoint but (512, 512, 1, 1) in the model! Skipped.
'backbone.bottom_up.stage5.OSA5_1.ese.fc.bias' has shape (1024,) in the checkpoint but (512,) in the model! Skipped.
'proposal_generator.fcos_head.cls_tower.0.weight' has shape (256, 256, 3, 3) in the checkpoint but (128, 128, 3, 3) in the model! Skipped.
'proposal_generator.fcos_head.cls_tower.0.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'proposal_generator.fcos_head.cls_tower.1.weight' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'proposal_generator.fcos_head.cls_tower.1.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'proposal_generator.fcos_head.cls_tower.3.weight' has shape (256, 256, 3, 3) in the checkpoint but (128, 128, 3, 3) in the model! Skipped.
'proposal_generator.fcos_head.cls_tower.3.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'proposal_generator.fcos_head.cls_tower.4.weight' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'proposal_generator.fcos_head.cls_tower.4.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'proposal_generator.fcos_head.bbox_tower.0.weight' has shape (256, 256, 3, 3) in the checkpoint but (128, 128, 3, 3) in the model! Skipped.
'proposal_generator.fcos_head.bbox_tower.0.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'proposal_generator.fcos_head.bbox_tower.1.weight' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'proposal_generator.fcos_head.bbox_tower.1.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'proposal_generator.fcos_head.bbox_tower.3.weight' has shape (256, 256, 3, 3) in the checkpoint but (128, 128, 3, 3) in the model! Skipped.
'proposal_generator.fcos_head.bbox_tower.3.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'proposal_generator.fcos_head.bbox_tower.4.weight' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'proposal_generator.fcos_head.bbox_tower.4.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'proposal_generator.fcos_head.cls_logits.weight' has shape (80, 256, 3, 3) in the checkpoint but (80, 128, 3, 3) in the model! Skipped.
'proposal_generator.fcos_head.bbox_pred.weight' has shape (4, 256, 3, 3) in the checkpoint but (4, 128, 3, 3) in the model! Skipped.
'proposal_generator.fcos_head.ctrness.weight' has shape (1, 256, 3, 3) in the checkpoint but (1, 128, 3, 3) in the model! Skipped.
'roi_heads.mask_head.mask_fcn1.weight' has shape (256, 256, 3, 3) in the checkpoint but (128, 128, 3, 3) in the model! Skipped.
'roi_heads.mask_head.mask_fcn1.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'roi_heads.mask_head.mask_fcn2.weight' has shape (256, 256, 3, 3) in the checkpoint but (128, 128, 3, 3) in the model! Skipped.
'roi_heads.mask_head.mask_fcn2.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'roi_heads.mask_head.deconv.weight' has shape (256, 256, 2, 2) in the checkpoint but (128, 128, 2, 2) in the model! Skipped.
'roi_heads.mask_head.deconv.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'roi_heads.mask_head.predictor.weight' has shape (80, 256, 1, 1) in the checkpoint but (80, 128, 1, 1) in the model! Skipped.
'roi_heads.maskiou_head.maskiou_fcn1.weight' has shape (256, 257, 3, 3) in the checkpoint but (128, 129, 3, 3) in the model! Skipped.
'roi_heads.maskiou_head.maskiou_fcn1.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'roi_heads.maskiou_head.maskiou_fcn2.weight' has shape (256, 256, 3, 3) in the checkpoint but (128, 128, 3, 3) in the model! Skipped.
'roi_heads.maskiou_head.maskiou_fcn2.bias' has shape (256,) in the checkpoint but (128,) in the model! Skipped.
'roi_heads.maskiou_head.maskiou_fc1.weight' has shape (1024, 12544) in the checkpoint but (1024, 6272) in the model! Skipped.

This missmatch only happend with lite and slim pretrained weights.

  • Centermask V-99

Something is not working with this pretrained weights of centermask2-V-99-eSE-FPN-ms-3x. The model don't detect cars on this image:

multiple_car

When centermask2-V-39-eSE-FPN-ms-3x or centermask2-V-57-eSE-FPN-ms-3x detects cars correctly.

@jgsch
Copy link
Author

jgsch commented Mar 3, 2020

I downloaded again the weights and modified some links in my code. The issue is now resolved.

@jgsch jgsch closed this as completed Mar 3, 2020
@eagle-ming
Copy link

I downloaded again the weights and modified some links in my code. The issue is now resolved.

how to solve this problem?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants