Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ISSUE-9: Implement immediate processing via Batch #10

Merged
merged 5 commits into from
Feb 17, 2021
Merged

Conversation

DiegoPino
Copy link
Member

See #9

This is working, I will do some more cleanup and improve the queue worker to deal with the other 3 operations as well. Can be tested already @alliomeria

And more will need to follow
Heavily inspirited on the queue_ui. I may clean this up more and simplify. Works on a per Set queue that does not have its own queue worker, which is on purpose so it can never be processed by Cron or QUEUE_UI, but will borrow during interactive Batch the ami_ingest_ado worker and do its "thing"

TODO: add locking mechanism so never two sets can be processed at the same time
Not used, the queue worker does the work
.. and start thinking this one needs to deal with all operations. Will create private methods for that
@alliomeria i also changed some wording and make some of the checkboxes/more clean. Immediate Batch processing works perfect now!
@DiegoPino DiegoPino self-assigned this Feb 16, 2021
@DiegoPino DiegoPino added enhancement New feature or request queue FIFO queue workers Ones taking the FI and doing the FO UI Buttons and pixels labels Feb 16, 2021
@alliomeria
Copy link
Contributor

Hello @DiegoPino, this worked great during testing. It felt nice, smoother to have the option to ingest immediately, and the language you added/adjusted explaining the Enqueue process is clear and helpful. Awesome! :)

@DiegoPino DiegoPino merged commit ee93a15 into main Feb 17, 2021
@DiegoPino
Copy link
Member Author

Thanks @alliomeria for testing, now it is merged. Now onto ZIP implementation

@DiegoPino DiegoPino deleted the ISSUE-9 branch March 7, 2021 16:31
giancarlobi added a commit that referenced this pull request May 18, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request queue workers Ones taking the FI and doing the FO queue FIFO UI Buttons and pixels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants