Missing key(s) in state_dict

[epetros]

Greetings,
Previously was able to save and load checkpoints, but today I get:
RuntimeError: Error(s) in loading state_dict for AutoregressiveWrapper:
Missing key(s) in state_dict: "net.net.routing_transformer.layers.blocks.0.f.net.fn.local_attn.rel_pos.weights", "net.net.routing_transformer.layers.blocks.1.f.net.fn.local_attn.rel_pos.weights", "net.net.routing_transformer.layers.blocks.2.f.net.fn.local_attn.rel_pos.weights", "net.net.routing_transformer.layers.blocks.3.f.net.fn.local_attn.rel_pos.weights", "net.net.routing_transformer.layers.blocks.4.f.net.fn.local_attn.rel_pos.weights", "net.net.routing_transformer.layers.blocks.5.f.net.fn.local_attn.rel_pos.weights", "net.net.routing_transformer.layers.blocks.6.f.net.fn.local_attn.rel_pos.weights", "net.net.routing_transformer.layers.blocks.7.f.net.fn.local_attn.rel_pos.weights".

Help please,
Thanks

[lucidrains]

@epetros oops, it's been fixed in the latest my bad f6ce3bb how is Routing Transformer working for you? well??

[epetros]

Thank you, but I still face the same issue, works only with v0.8.4. Am using enwik8_deepspeed with my own dataset, seems to be very fast and loss is decreasing but guess it's still early (loss ~0.9) to get nice generation results.

[lucidrains]

@epetros fixed for real now lol 1341f69

[epetros]

It's fixed, thanks.