Rebuilding elastic index takes a lot of time

[konika-jindal]

I am having almost 25000 data for an elasticsearch index to rebuild , it takes almost 12-14 hours to rebuild , if I want to add just a small change and rebuild or reset then it takes almost 12-14 hours to rebuild . I want to reduce its time . How can I do that?

[sebastienros]

@konika-jindal do you have suggestions to improve it? Have you tried debugging the background indexing task and see what part was taking too much time? For instance could you try to change the batch size to see if it has any effect.

Maybe there is a way to batch the documents that are sent to ES, it could be a way to improve perf. Or maybe other best practices on how to optimize big numbers of documents to ES. Could try to you investigate?

[konika-jindal]

Yes sure , I will try out these ways and let you know for same .

[hyzx86]

This PR may be related to this issue, but I don't have time to deal with them at the moment.

#14063

[konika-jindal]

I am not getting anything in background task as required , is there another way to go?

[github-actions]

It seems that this issue didn't really move for quite a while despite us asking the author for further feedback. Is this something you'd like to revisit any time soon or should we close? Please reply.