Skip to content

Separate unittest to two and add code coverage for e2e#261

Closed
kaiwenw wants to merge 1 commit into
facebookresearch:masterfrom
kaiwenw:separate_unittest
Closed

Separate unittest to two and add code coverage for e2e#261
kaiwenw wants to merge 1 commit into
facebookresearch:masterfrom
kaiwenw:separate_unittest

Conversation

@kaiwenw
Copy link
Copy Markdown
Contributor

@kaiwenw kaiwenw commented May 8, 2020

  • Add coverage.py for end-to-end test.
  • Make setup.cfg only contain what the user needs to run, and move testing specific options to tox and circleci config.
  • Split gpu_unittest into gym tests and everything else
  • Improve test stability.

@kaiwenw kaiwenw force-pushed the separate_unittest branch from 40b4cdd to cb84b62 Compare May 8, 2020 14:38
@kaiwenw kaiwenw changed the title split up regular unittest and gym unittest in circleci Separate unittest to two and add code coverage for e2e May 8, 2020
@kaiwenw kaiwenw force-pushed the separate_unittest branch 17 times, most recently from e55037b to 5a1c14d Compare May 8, 2020 21:48
Copy link
Copy Markdown

@facebook-github-bot facebook-github-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kaiwenw has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

@kaiwenw kaiwenw force-pushed the separate_unittest branch 6 times, most recently from 9f41166 to f8314b1 Compare May 9, 2020 05:01
Copy link
Copy Markdown

@facebook-github-bot facebook-github-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kaiwenw has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

@kaiwenw kaiwenw force-pushed the separate_unittest branch from f8314b1 to 9405468 Compare May 9, 2020 05:33
Copy link
Copy Markdown

@facebook-github-bot facebook-github-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kaiwenw has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

kaiwenw added a commit to kaiwenw/ReAgent that referenced this pull request May 9, 2020
…rch#261)

Summary:
- Add coverage.py for end-to-end test.
- Make setup.cfg only contain what the user needs to run, and move testing specific options to tox and circleci config.
- Split gpu_unittest into gym tests and everything else
- Improve test stability.
Pull Request resolved: facebookresearch#261

Differential Revision: D21489212

Pulled By: kaiwenw

fbshipit-source-id: e321592de1ad40bdc7891f32eefef0659fff2b4b
@facebook-github-bot
Copy link
Copy Markdown

This pull request was exported from Phabricator. Differential Revision: D21489212

kaiwenw added a commit to kaiwenw/ReAgent that referenced this pull request May 10, 2020
…rch#261)

Summary:
- Add coverage.py for end-to-end test.
- Make setup.cfg only contain what the user needs to run, and move testing specific options to tox and circleci config.
- Split gpu_unittest into gym tests and everything else
- Improve test stability.
Pull Request resolved: facebookresearch#261

Differential Revision: D21489212

Pulled By: kaiwenw

fbshipit-source-id: 326ad47213383bd975bc49e9b82d1d61738d8416
@kaiwenw kaiwenw force-pushed the separate_unittest branch from 2118f7d to 0bf48b0 Compare May 10, 2020 18:28
@facebook-github-bot
Copy link
Copy Markdown

This pull request was exported from Phabricator. Differential Revision: D21489212

@codecov-io
Copy link
Copy Markdown

codecov-io commented May 10, 2020

Codecov Report

Merging #261 into master will increase coverage by 1.07%.
The diff coverage is 73.33%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #261      +/-   ##
==========================================
+ Coverage   84.04%   85.12%   +1.07%     
==========================================
  Files         225      226       +1     
  Lines       14473    14487      +14     
  Branches       42       42              
==========================================
+ Hits        12164    12332     +168     
+ Misses       2285     2131     -154     
  Partials       24       24              
Impacted Files Coverage Δ
reagent/gym/tests/test_gym.py 98.46% <ø> (ø)
reagent/gym/types.py 85.71% <ø> (ø)
reagent/workflow/model_managers/model_manager.py 87.61% <ø> (ø)
reagent/gym/policies/samplers/discrete_sampler.py 50.00% <71.42%> (ø)
reagent/test/preprocessing/test_postprocessing.py 100.00% <100.00%> (ø)
...agent/workflow/model_managers/discrete_dqn_base.py 98.82% <100.00%> (+0.01%) ⬆️
reagent/debug_on_error.py 36.36% <0.00%> (ø)
reagent/types.py 89.74% <0.00%> (+0.32%) ⬆️
reagent/preprocessing/normalization.py 73.71% <0.00%> (+0.64%) ⬆️
reagent/workflow/data_fetcher.py 85.94% <0.00%> (+2.16%) ⬆️
... and 13 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 49b7168...0bf48b0. Read the comment docs.

kaiwenw added a commit to kaiwenw/ReAgent that referenced this pull request May 11, 2020
…rch#261)

Summary:
- Add coverage.py for end-to-end test.
- Make setup.cfg only contain what the user needs to run, and move testing specific options to tox and circleci config.
- Split gpu_unittest into gym tests and everything else
- Improve test stability.
Pull Request resolved: facebookresearch#261

Differential Revision: D21489212

Pulled By: kaiwenw

fbshipit-source-id: 4872e898700c4b3afcd0bb064b95d4394465b3ae
kaiwenw added a commit to kaiwenw/ReAgent that referenced this pull request May 11, 2020
…rch#261)

Summary:
- Add coverage.py for end-to-end test.
- Make setup.cfg only contain what the user needs to run, and move testing specific options to tox and circleci config.
- Split gpu_unittest into gym tests and everything else
- Improve test stability.
Pull Request resolved: facebookresearch#261

Differential Revision: D21489212

Pulled By: kaiwenw

fbshipit-source-id: b2219ed5a18e6abfe87966561e368527649c5d21
kaiwenw added a commit to kaiwenw/ReAgent that referenced this pull request May 11, 2020
…rch#261)

Summary:
- Add coverage.py for end-to-end test.
- Make setup.cfg only contain what the user needs to run, and move testing specific options to tox and circleci config.
- Split gpu_unittest into gym tests and everything else
- Improve test stability.
Pull Request resolved: facebookresearch#261

Differential Revision: D21489212

Pulled By: kaiwenw

fbshipit-source-id: eee22283cf9b18cbb4db761cc4f1be1301546337
kaiwenw added a commit to kaiwenw/ReAgent that referenced this pull request May 11, 2020
…rch#261)

Summary:
- Add coverage.py for end-to-end test.
- Make setup.cfg only contain what the user needs to run, and move testing specific options to tox and circleci config.
- Split gpu_unittest into gym tests and everything else
- Improve test stability.
Pull Request resolved: facebookresearch#261

Differential Revision: D21489212

Pulled By: kaiwenw

fbshipit-source-id: c9b3a4f1e18129b81e79c1c0940fe9ae901ed625
kaiwenw added a commit to kaiwenw/ReAgent that referenced this pull request May 11, 2020
…rch#261)

Summary:
- Add coverage.py for end-to-end test.
- Make setup.cfg only contain what the user needs to run, and move testing specific options to tox and circleci config.
- Split gpu_unittest into gym tests and everything else
- Improve test stability.
Pull Request resolved: facebookresearch#261

Differential Revision: D21489212

Pulled By: kaiwenw

fbshipit-source-id: 82bcf6fb010e2c05291241b47abc42a95adaa654
@kaiwenw kaiwenw force-pushed the separate_unittest branch from 0bf48b0 to a0b8966 Compare May 11, 2020 05:46
@facebook-github-bot
Copy link
Copy Markdown

This pull request was exported from Phabricator. Differential Revision: D21489212

kaiwenw added a commit to kaiwenw/ReAgent that referenced this pull request May 11, 2020
…rch#261)

Summary:
- Add coverage.py for end-to-end test.
- Make setup.cfg only contain what the user needs to run, and move testing specific options to tox and circleci config.
- Split gpu_unittest into gym tests and everything else
- Improve test stability.
Pull Request resolved: facebookresearch#261

Differential Revision: D21489212

Pulled By: kaiwenw

fbshipit-source-id: 9fd69acd039c870ee5cf57229369eb67cc430bde
kaiwenw added a commit to kaiwenw/ReAgent that referenced this pull request May 11, 2020
…rch#261)

Summary:
- Add coverage.py for end-to-end test.
- Make setup.cfg only contain what the user needs to run, and move testing specific options to tox and circleci config.
- Split gpu_unittest into gym tests and everything else
- Improve test stability.
Pull Request resolved: facebookresearch#261

Differential Revision: D21489212

Pulled By: kaiwenw

fbshipit-source-id: de8c8e56d616d88806f1f3c2a382cbe0a8218a68
kaiwenw added a commit to kaiwenw/ReAgent that referenced this pull request May 11, 2020
…rch#261)

Summary:
- Add coverage.py for end-to-end test.
- Make setup.cfg only contain what the user needs to run, and move testing specific options to tox and circleci config.
- Split gpu_unittest into gym tests and everything else
- Improve test stability.
Pull Request resolved: facebookresearch#261

Differential Revision: D21489212

Pulled By: kaiwenw

fbshipit-source-id: f5cd01154ed443f8ff8d935fee401417fb03e85e
kaiwenw added a commit to kaiwenw/ReAgent that referenced this pull request May 11, 2020
…rch#261)

Summary:
- Add coverage.py for end-to-end test.
- Make setup.cfg only contain what the user needs to run, and move testing specific options to tox and circleci config.
- Split gpu_unittest into gym tests and everything else
- Improve test stability.
Pull Request resolved: facebookresearch#261

Reviewed By: kittipatv

Differential Revision: D21489212

Pulled By: kaiwenw

fbshipit-source-id: a550d66b9a62e997e1e33fbc2ad3b3540e0b5044
@kaiwenw kaiwenw force-pushed the separate_unittest branch from a0b8966 to 6b72b93 Compare May 11, 2020 20:13
@facebook-github-bot
Copy link
Copy Markdown

This pull request was exported from Phabricator. Differential Revision: D21489212

kaiwenw added a commit to kaiwenw/ReAgent that referenced this pull request May 11, 2020
…rch#261)

Summary:
- Add coverage.py for end-to-end test.
- Make setup.cfg only contain what the user needs to run, and move testing specific options to tox and circleci config.
- Split gpu_unittest into gym tests and everything else
- Improve test stability.
Pull Request resolved: facebookresearch#261

Differential Revision: D21489212

Pulled By: kaiwenw

fbshipit-source-id: da484a1abb902bf2fd1017f914878653415f7f22
kaiwenw added a commit to kaiwenw/ReAgent that referenced this pull request May 11, 2020
…rch#261)

Summary:
- Add coverage.py for end-to-end test.
- Make setup.cfg only contain what the user needs to run, and move testing specific options to tox and circleci config.
- Split gpu_unittest into gym tests and everything else
- Improve test stability.
Pull Request resolved: facebookresearch#261

Differential Revision: D21489212

Pulled By: kaiwenw

fbshipit-source-id: 43dda06e8934a13fb98ff7196fbb4f28e4e52ca3
kaiwenw added a commit to kaiwenw/ReAgent that referenced this pull request May 11, 2020
…rch#261)

Summary:
- Add coverage.py for end-to-end test.
- Make setup.cfg only contain what the user needs to run, and move testing specific options to tox and circleci config.
- Split gpu_unittest into gym tests and everything else
- Improve test stability.
Pull Request resolved: facebookresearch#261

Differential Revision: D21489212

Pulled By: kaiwenw

fbshipit-source-id: 0746d4fb97b2872f6e851bde5218eddfd594e32e
…rch#261)

Summary:
- Add coverage.py for end-to-end test.
- Make setup.cfg only contain what the user needs to run, and move testing specific options to tox and circleci config.
- Split gpu_unittest into gym tests and everything else
- Improve test stability.
Pull Request resolved: facebookresearch#261

Reviewed By: kittipatv

Differential Revision: D21489212

Pulled By: kaiwenw

fbshipit-source-id: 783546980a77e267930d5f153a8973481367f960
@kaiwenw kaiwenw force-pushed the separate_unittest branch from 6b72b93 to 74a24dd Compare May 12, 2020 01:17
@facebook-github-bot
Copy link
Copy Markdown

This pull request was exported from Phabricator. Differential Revision: D21489212

kaiwenw added a commit to kaiwenw/ReAgent that referenced this pull request May 12, 2020
…rch#261)

Summary:
- Add coverage.py for end-to-end test.
- Make setup.cfg only contain what the user needs to run, and move testing specific options to tox and circleci config.
- Split gpu_unittest into gym tests and everything else
- Improve test stability.
Pull Request resolved: facebookresearch#261

Differential Revision: D21489212

Pulled By: kaiwenw

fbshipit-source-id: 8ad82e139e65d1de04f9a5cd2032f81f83646ccf
@facebook-github-bot
Copy link
Copy Markdown

@kaiwenw merged this pull request in af01952.

@kaiwenw kaiwenw deleted the separate_unittest branch May 20, 2020 22:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants