-
Notifications
You must be signed in to change notification settings - Fork 68
[AL-1859] Update SDK Tests for On-Prem #527
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
It is difficult to make this consistently pass all test cases. The test results are very flaky for on-prem instance. Example test case: Running several times will allow the test case to pass, but it is not guaranteed with X number of times. With no changes, the same test can fail and pass in succession. Edit 4/8: |
…unt of time for label import. this should be updated since we changed how label creation is done via tests now
…s has not yet been updated
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
One nit, otherwise looks good.
…be full hostname instead of instance id
Update to test cases and availability to run on-prem given your local environment has the following var:
LABELBOX_TEST_API_KEY_ONPREM
- take the api key from the onprem instanceLABELBOX_TEST_ONPREM_HOSTNAME
example - https://app.replicated-bb2f865.labelbox.dev