Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bulkrax importers stuck pending in prod post-Knapsack #170

Closed
Tracked by #134
KatharineV opened this issue Apr 18, 2024 · 1 comment
Closed
Tracked by #134

Bulkrax importers stuck pending in prod post-Knapsack #170

KatharineV opened this issue Apr 18, 2024 · 1 comment
Assignees
Labels
bug something isn't working Knapsack Upgrade

Comments

@KatharineV
Copy link

I can get Bulkrax importers to run on staging, but everything I've launched on a production tenant today is stuck pending. It's been a few hours, and nothing is moving. This may be related to #172 and the importers that won't update, but I'm making a separate ticket for now, just in case.

See these examples on ADL and SDAPI:

https://sdapi.b2.adventistdigitallibrary.org/importers/439?locale=en
https://sdapi.b2.adventistdigitallibrary.org/importers/438?locale=en

https://adl.b2.adventistdigitallibrary.org/importers/311?locale=en

@KatharineV KatharineV added bug something isn't working Knapsack Upgrade labels Apr 18, 2024
@ShanaLMoore
Copy link
Contributor

ShanaLMoore commented Apr 23, 2024

I believe things are working, just rather slowly. There are about 7 jobs that are taking FOREVER to finish. We have a thread count of 10 so that really means when we start a new import, only 3 threads becomes available giving the appearance of a slow or stuck ingest. We're still looking into this. 👀

image

Tested using a small import: https://april-test.b2.adventistdigitallibrary.org/importers/2?locale=en

image

image

@kirkkwang kirkkwang transferred this issue from scientist-softserv/adventist-dl May 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug something isn't working Knapsack Upgrade
Projects
Archived in project
Development

No branches or pull requests

3 participants