Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow scheduling new job manually #350

Open
jpmckinney opened this issue Apr 27, 2024 · 0 comments
Open

Allow scheduling new job manually #350

jpmckinney opened this issue Apr 27, 2024 · 0 comments

Comments

@jpmckinney
Copy link
Member

jpmckinney commented Apr 27, 2024

The old instructions to delete jobs in order to allow new jobs to run can cause all sorts of issues. Namely, deleting a job could delete a Kingfisher Process collection or Pelican dataset while work is still queued in RabbitMQ, which could cause 100,000s of errors to be reported to Sentry.

We can instead have a process where a job can be manually scheduled, and delete those instructions. There are two scenarios to consider:

  • Last job is complete, but we want to run a new job sooner than scheduled.
    • We can check that the collection isn't already is_out_of_date (to avoid duplication by manageprocess if e.g. an admin unfreezes a publication, and is then in a rush to schedule it, instead of waiting 5 mins), and then create the job. (This scenario also checks that no job is running.)
  • Last job is running.

Update the docs that refer to this issue (#350) and surrounding text.

Add relevant tests first #128

Blocked by #352

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant