Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open access ingestion is slow #649

Open
datalogics-tsmith opened this issue Aug 25, 2017 · 1 comment
Open

Open access ingestion is slow #649

datalogics-tsmith opened this issue Aug 25, 2017 · 1 comment

Comments

@datalogics-tsmith
Copy link
Collaborator

When ingesting open access content on our last few servers the process has run and slowly accumulated books over the course of several days. After four days we have roughly 50k books on the one server, with more coming

@aslagle
Copy link
Collaborator

aslagle commented Aug 25, 2017

@datalogics-tsmith Were you trying to ingest a smaller number of books? We have the smaller instant classics list with about 5k books, but there was a bug that would cause it to end up ingesting the entire content server when you tried to ingest the smaller list. That's https://github.com/NYPL-Simplified/content_server/issues/137 - I fixed it but didn't deploy the update yet.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants