Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: 馃悰 don't mark empty splits as stalled #366

Merged
merged 18 commits into from
Jun 10, 2022

Conversation

severo
Copy link
Collaborator

@severo severo commented Jun 9, 2022

should fix #185 and #177

@severo severo force-pushed the fix-empty-split-marked-as-stalled branch from 5273a8a to 369b685 Compare June 9, 2022 19:21
no need to create a release for that.

BREAKING CHANGE: 馃Ж is_dataset_in_queue and is_split_in_queue are removed
and also simplify the logic: don't look at the queue, it's not the
business of the user
the errors now have a MAX_AGE_SHORT_SECONDS cache duration, and we set
it to 2s for the tests. This way, we can do real e2e tests through the
nginx proxy, and still have quick results.
the test works locally, but not on the CI
@severo
Copy link
Collaborator Author

severo commented Jun 10, 2022

^ it's weird: I added a test, and now the other failing tests are working.

Possibly we have to improve the control of the startup with docker compose: https://docs.docker.com/compose/startup-order/.

And we should not start the tests before all the infrastructure is ready (db, API, workers)

now that the response time of all the endpoints is low, and while the
traffic is low, I think it's better to have a simpler logic in the nginx
cache: never use stale cache entries, always ask the api for the
response if not in the cache.
also: reduce the cache time under the duration of the tests
@severo severo changed the title fix: 馃悰 don't mark empty splits as stalled fix: 馃悰 don't mark empty splits as stale Jun 10, 2022
@severo severo changed the title fix: 馃悰 don't mark empty splits as stale fix: 馃悰 don't mark empty splits as stalled Jun 10, 2022
@severo severo merged commit e64150b into main Jun 10, 2022
@severo severo deleted the fix-empty-split-marked-as-stalled branch June 10, 2022 09:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

No data on nielsr/CelebA-faces
1 participant