Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Long-running tasks #130

Closed
3 tasks done
nphilipp opened this issue Dec 6, 2021 · 0 comments · Fixed by #137
Closed
3 tasks done

Long-running tasks #130

nphilipp opened this issue Dec 6, 2021 · 0 comments · Fixed by #137
Assignees
@nphilipp
Labels
API backend
Projects
Q4/2021 Initiative

Comments

@nphilipp
Copy link
Collaborator

nphilipp commented Dec 6, 2021 •
edited

Story

As a user of Duffy,
I want that my requests are answered quickly,
so that I don't feel ignored.

Acceptance Criteria

  • A suitable task worker framework is integrated and can be used for long-running tasks.
    • Celery is set up to process tasks generated by the API frontend
    • Redis is set up to manage the queue(s) of tasks that need to processed

Background

There are a couple of things which need a longer time than what people expect an API call to take: provision a new node with an operating system (to be put into a pool for quick reuse), set up a provisioned host with SSH keys etc. before it can be handed out to tenants.
@nphilipp nphilipp created this issue from a note in Q4/2021 Initiative (To do) Dec 6, 2021
@nphilipp nphilipp moved this from To do to In progress in Q4/2021 Initiative Dec 6, 2021
@nphilipp nphilipp self-assigned this Dec 6, 2021
nphilipp added a commit to nphilipp/duffy that referenced this issue Dec 8, 2021
@nphilipp
Add tasks module and worker subcommand
5ec4ecc 
The tasks module will contain potentially long-running operations, like
checking node pools and topping them up. These tasks will be performed
by a Celery worker in the background and only triggered from the
controller function in order to not block the API.

Fixes: CentOS#130

Signed-off-by: Nils Philippsen <nils@redhat.com>
nphilipp added a commit to nphilipp/duffy that referenced this issue Dec 8, 2021
@nphilipp
Add tasks module and worker subcommand
54d8195 
The tasks module will contain potentially long-running operations, like
checking node pools and topping them up. These tasks will be performed
by a Celery worker in the background and only triggered from the
controller function in order to not block the API.

Fixes: CentOS#130

Signed-off-by: Nils Philippsen <nils@redhat.com>
@nphilipp nphilipp linked a pull request Dec 8, 2021 that will close this issue
Add tasks module and worker subcommand #137
Merged
@nphilipp nphilipp moved this from In progress to In Review in Q4/2021 Initiative Dec 8, 2021
Q4/2021 Initiative automation moved this from In Review to Done Dec 9, 2021
nphilipp added a commit that referenced this issue Dec 9, 2021
@nphilipp
Add tasks module and worker subcommand
482b21c 
The tasks module will contain potentially long-running operations, like
checking node pools and topping them up. These tasks will be performed
by a Celery worker in the background and only triggered from the
controller function in order to not block the API.

Fixes: #130

Signed-off-by: Nils Philippsen <nils@redhat.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@nphilipp nphilipp

Labels
API backend
Projects
No open projects
Q4/2021 Initiative
Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add tasks module and worker subcommand nphilipp/duffy
1 participant
@nphilipp