Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move worker reported back from scheduler to webui #2606

Conversation

Martchus
Copy link
Contributor

Same as #2595 which was buggy.

Marking previous jobs of a worker as incomplete when it shows up again is so far handled within the web socket server and the registration API route. This change moves all aspects of handling this to the API. This will hopefully scale better because the regular API can use preforking.

See https://progress.opensuse.org/issues/60866

@@ -355,7 +370,6 @@ is_deeply($grabbed->{settings}, $job_ref->{settings}, "settings correct");
my $job3_id = $job->id;
my $job_id = $grabbed->{id};

sleep 1;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you are deleting sleeps in code. I love you for this already! 😗 😏

@okurz
Copy link
Member

okurz commented Dec 16, 2019

only tidy check failed.

* Move the code from the scheduler and web socket server to the web UI
  instead of having it spread over different places
* Improve scalability because the web UI can make use of preforking
* Avoid redundant code
* Improve error handling of reschedule_state/reschedule_rollback
* Remove code for marking the current job of the worker as running
  when it connects to the web socket server because on the first
  status update it will be considered running anyways
* Do not incomplete assigned jobs on worker re-registration but
  re-schedule them instead like it was done on the web socket server
  side already
* Do the re-scheduling of assigned jobs directly within the web
  socket server. (It can not moved to the web UI for reasons stated
  in code comments.)
* See https://progress.opensuse.org/issues/60866
* Reduce the execution time by several seconds by reducing/mocking
  the status update interval and some sleeps
* Add further notes
* Make the unstable workers not that unstable for the sake of this
  tests. There's still 'simulation of heavy unstable load'.
@Martchus Martchus force-pushed the move_worker_reported_back_from_scheduler_to_webui branch from ca5a73b to b664fff Compare December 16, 2019 13:45
@Martchus Martchus merged commit f092e4b into os-autoinst:master Dec 17, 2019
@Martchus Martchus deleted the move_worker_reported_back_from_scheduler_to_webui branch December 17, 2019 09:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants