-
Notifications
You must be signed in to change notification settings - Fork 9
Open
Labels
enhancementNew feature or requestNew feature or requestinvestigation-neededExpecting a more thorough investigation to resolve this issueExpecting a more thorough investigation to resolve this issue
Description
@VolodyaCO brought this up at https://github.com/dwavesystems/dwave-pytorch-plugin/pull/47/files#r2577897489 .
Empirically, the current weight initialization scheme tends to result in optimizer getting trapped in poor local optima.
We should run a simple experiment to pick a better initialization scheme.
For what it's worth, I've found initializing weights to 0 to be quite robust.
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or requestinvestigation-neededExpecting a more thorough investigation to resolve this issueExpecting a more thorough investigation to resolve this issue