How to scale Heritrix with Kubernetes? #524
Unanswered
naveen17797
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
i would like to scale heritrix with kubernetes, but it appears that it is more complicated.
i am scheduling crawl via heritrix REST API, but actions like
seems to directly altering the pod state making it impossible to scale to multiple instances running different crawl tasks.
for example if the pods p1, p2, p3 are running and i send build, launch, unpause rest api requests to heritrix its not guaranteed to be sent to same pod as there are multiple instances running.
whats the correct way to scale heritrix with kubernetes?
Beta Was this translation helpful? Give feedback.
All reactions