Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DM-27171: Speed up gen3 ingest tests #315

Merged
merged 5 commits into from
Oct 17, 2020
Merged

DM-27171: Speed up gen3 ingest tests #315

merged 5 commits into from
Oct 17, 2020

Commits on Oct 16, 2020

  1. Configuration menu
    Copy the full SHA
    a471c76 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2020

  1. Only run full raw read in one of the ingest tests

    We do not need to read the same raws in every ingest check.
    We also do not need to read every raw dataset that was ingested.
    Read the first raw completely but for subsequent raws
    just read some metadata to demonstrate that the datastore
    can read them.
    
    Changing this can make significant improvements to test
    runtimes.
    timj committed Oct 17, 2020
    Configuration menu
    Copy the full SHA
    f941310 View commit details
    Browse the repository at this point in the history
  2. Move the call to checkRepo out of the loop

    It doesn't depend on any of the loop variables.
    timj committed Oct 17, 2020
    Configuration menu
    Copy the full SHA
    431a41f View commit details
    Browse the repository at this point in the history
  3. Fix inplace test

    Previously the in place code was never triggering and it
    was picking up the original file. Now explicitly override
    the file being ingested and check that the URI matches our
    expectations.
    timj committed Oct 17, 2020
    Configuration menu
    Copy the full SHA
    c928470 View commit details
    Browse the repository at this point in the history
  4. Use single butler for each test class

    Register instrument takes a while for some instruments
    and it always does the same thing and can be reused for
    each test.
    timj committed Oct 17, 2020
    Configuration menu
    Copy the full SHA
    62d0741 View commit details
    Browse the repository at this point in the history