Join GitHub today
Wekan hung up after upload big json #1488
Unfortunately, I can’t send in the public space this json because it contains private data. But I can tell you count of keys: approximately 28000 pairs.
[Bottom up (heavy) profile]:
ticks parent name
It’s look like the frontend tries to update of each card in realtime and generating a lot of requests to backend. Does this version make sense?
Yes. Meteor.js framework parses MongoDB changes realtime and updates everything realtime.
For that amount of data, you need to have Wekan server installed similarly like production cluster at AWS with high-speed connectivity for Wekan to be useable. I would also recommend adding redis oplog as described in the link above.
When importing that large board, it's very likely that Wekan tries to get a lot of attachments from Trello, and if server is not powerful enough, you could have timeouts, or have some data missing.
I have not tried redis-oplog yet, because without that performance has been enough for thousands of users.
Wekan already has mixmax:smart-disconnect added. You see it that Wekan only updates itself on webbrowser when browser tab is active. When you use other browser tab, Wekan will timeout and be idle, and when you switch back to Wekan tab, Wekan will connect to backend again and update webpage.
For your use case, having Wekan installed on one powerful enough server installed at AWS or elsewhere (other than your laptop) should be enough to get that big Trello JSON imported. You can add comment to this issue about did it work for you.