Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Metrics/Write Preds Testing #697

Merged
merged 17 commits into from
Jun 19, 2019
Merged

Update Metrics/Write Preds Testing #697

merged 17 commits into from
Jun 19, 2019

Conversation

pruksmhc
Copy link
Contributor

@pruksmhc pruksmhc commented May 27, 2019

Tests to determine that updating metrics and writing predictions works as expected.

@pep8speaks
Copy link

pep8speaks commented May 27, 2019

Hello @pruksmhc! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

Line 36:89: W291 trailing whitespace
Line 37:77: W291 trailing whitespace
Line 38:88: W291 trailing whitespace
Line 40:22: W291 trailing whitespace
Line 215:86: W291 trailing whitespace

You can repair most issues by installing black and running: black -l 100 ./*. If you contribute often, have a look at the 'Contributing' section of the README for instructions on doing this automatically.

Comment last updated at 2019-06-19 01:15:43 UTC

@pruksmhc pruksmhc changed the title Update Metrics/Write Preds Testing WIP Update Metrics/Write Preds Testing Jun 2, 2019
tests/test_update_metrics.py Outdated Show resolved Hide resolved
tests/test_write_preds.py Outdated Show resolved Hide resolved
tests/test_write_preds.py Show resolved Hide resolved
tests/test_write_preds.py Show resolved Hide resolved
@pruksmhc
Copy link
Contributor Author

pruksmhc commented Jun 6, 2019

Ready for another review @sleepinyourhat

tests/test_update_metrics.py Outdated Show resolved Hide resolved
tests/test_update_metrics.py Outdated Show resolved Hide resolved
tests/test_write_preds.py Outdated Show resolved Hide resolved
@sleepinyourhat
Copy link
Contributor

Last bit of cleanup, plus make sure tests pass.

Copy link
Collaborator

@W4ngatang W4ngatang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some minor things

tests/test_write_preds.py Outdated Show resolved Hide resolved
environment.yml Outdated
@@ -16,6 +16,7 @@ dependencies:
- tensorboard
- tensorboardX==1.2
- sendgrid==5.4.1
- pyhocon==0.3.35
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure why this is appearing in this diff - this is the same as master.

self.wic.val_data = [
Instance(
{
"sent1_str": MetadataField("Room and board yo."),
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is this a real example??

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh nope :P , deleting the yo

Copy link
Collaborator

@W4ngatang W4ngatang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not super familiar with testing, so do makes sure to test these and address the minor comments.

Copy link
Contributor

@sleepinyourhat sleepinyourhat left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some cleanup (in addition to Alex's requests), but happy to approve. Merge when ready.

tests/test_update_metrics.py Show resolved Hide resolved
@pruksmhc pruksmhc merged commit 785a4b3 into master Jun 19, 2019
phu-pmh pushed a commit that referenced this pull request Apr 17, 2020
* adding initial tests

* adding initial tests

* black formatting

* adding more than 1 val_preds, changing sts-b example

* reduced to 2 examples for update_metrics

* batch siz eof one test,  cleaning up tests

* changing directory for .CircleCI builds

* removed extra changes

* fixing WiC.jsonl name in write_preds_test

* black

* nit picking

* black styling
@jeswan jeswan added the jiant-v1-legacy Relevant to versions <= v1.3.2 label Sep 17, 2020
@jeswan jeswan deleted the check_update_metrics branch September 22, 2020 03:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
jiant-v1-legacy Relevant to versions <= v1.3.2
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants