Skip to content

[WIP] Adaptive loss reweighting #291

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 2 commits into from
Closed

[WIP] Adaptive loss reweighting #291

wants to merge 2 commits into from

Conversation

@zoemcc
Copy link
Contributor

@zoemcc zoemcc commented Apr 13, 2021 •
edited
Loading

Basic structure is here for adaptive losses.

TODO:

  • Finish performance debugging (highest priority), currently NonAdaptiveLoss performs better than the adaptive loss even on very simple cases
  • Add more strategies for reweighting (i.e. from Automatic weighting between equations #155 )
  • Split up PDE and BC loss terms and add one loss weight for each term
  • Integrate the tests into the main test script/expand test cases
  • Thorough performance benchmarking
  • Make sure GPU support isn't hindered
  • Clean up the manual instrumentation, add documentation & example script in the docs

zoemcc added 2 commits April 10, 2021 18:19
@zoemcc
Initial implementation of weighted loss and first test. Currently way…
231bafe 
… over satisfies the BC loss compared to the PDE loss in the test case, this may be because it is a point BC constraint.
@zoemcc
More instrumentation, better test case, refactored loss_function, add…
3900b4e 
…ed efficient NonAdaptiveLoss and made it default.
@zoemcc
Copy link
Contributor Author

zoemcc commented Jan 20, 2022

Using this PR with a different branch instead: #482

@zoemcc zoemcc closed this Jan 20, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@zoemcc