Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement exaggeration #14

Closed
einbandi opened this issue Jul 11, 2022 · 2 comments
Closed

Implement exaggeration #14

einbandi opened this issue Jul 11, 2022 · 2 comments

Comments

@einbandi
Copy link
Collaborator

Implement (early) exaggeration, which means that relation values are rescaled by a given factor for the first few epochs. The relation loss has to be rescaled accordingly. This could be specified in the relation loss.

@einbandi
Copy link
Collaborator Author

Much easier, and a nice proof of the generalization of training phases: implement Exaggerate transform that simply multiplies the relations by a given factor. Still, to get correct scaling of the relation loss it will be necessary to detect the existence of an exaggeration transform inside ParametricDR and pass the info on to the loss.

@einbandi
Copy link
Collaborator Author

I decided to not implement this at all for now. Users can specify exaggeration easily via a Functional transform. The just have to rescale the loss themselves, if at all necessary.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
No open projects
Development

No branches or pull requests

1 participant