Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add SameDiff UI listener (for tuning, debugging, etc) #7787

Merged
merged 11 commits into from May 27, 2019

Conversation

@AlexDBlack
Copy link
Contributor

commented May 27, 2019

MVP implementation so far. It works OK, but needs a lot of polish (mainly on the front-end side, that this PR doesn't address). This will be further improved/polished in the near future.

The listener (so far) can collect and chart the following:

  • Losses (including a breakdown by type)
  • Learning rate
  • Evaluation (for classification) - running eval on training set (test set eval: to be added)
  • Update ratios for parameters (mean magnitude or L2 ratio: updates / parameters)

Also includes some important fixes to BERT wordpiece functionality/iterator.
Adds a ramp ISchedule implementation.

@AlexDBlack AlexDBlack merged commit 24818d7 into dev_20190513 May 27, 2019

1 check was pending

continuous-integration/jenkins/pr-head This commit is being built
Details

@AlexDBlack AlexDBlack deleted the ab_ui_listener branch May 27, 2019

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
1 participant
You can’t perform that action at this time.