I need help for improving speed of the exports... #1132
Replies: 3 comments 8 replies
-
|
Your best bet at improving speed is to use a bot token and setting parallelization to higher values. You can use message filters to only include messages with links (it will still have to pull all of them, but the output will be smaller in size). Otherwise, there's only so much you can do to speed up the process of fetching tens of millions of messages (which is usually the case on busier servers). |
Beta Was this translation helpful? Give feedback.
-
|
mhmm... 1.1 will be useful. |
Beta Was this translation helpful? Give feedback.
-
|
1.2 is also possible: proof: |
Beta Was this translation helpful? Give feedback.
-
|
please consider adding one of these at least. It would be much useful for me, and maybe others, who knows. |
Beta Was this translation helpful? Give feedback.
-
|
You can't access search through the API, IIRC |
Beta Was this translation helpful? Give feedback.
-
|
Yeah, only users can access this endpoint. but it would be a good feature to add to the Exporter's user mode. |
Beta Was this translation helpful? Give feedback.
-
|
Which format would be the faster to export for the program? |
Beta Was this translation helpful? Give feedback.
-
|
another suggestion, can we export to specific folder by server name? |
Beta Was this translation helpful? Give feedback.
-
I'm using this project to do something pretty huge, I plan on exporting around 60 Discord server and retrieve all the possible available channels in export.
The goal will be to retrieve every single links sent in all of these servers. Now I'm kindda wondering, I'm at my first server attempt, and it already takes ages to export, it doesn't even reach 10% in 2 hours or something...
I tried both CLI and GUI versions, with a few parameters (I tried the only output links option that is somewhere there in the docs...)
Well nothing seems fast. Any suggestions to improve my output being generated faster..? Cuz currently I think I would be dead before I achieve it lol
Also trough this post I want to make 2 requests:
1.1 Have the possibility to sort the servers from members (this can helps to know if the export is likely gonna take a very long time)
1.2 Have the possibility to sort the servers from messages sent (this can significantly helps to know if the export is likely gonna take a very long time)
2.1 Makes it possible to see a percentage progress in the GUI output, I believe I seen that request somewhere in the discussions there.
2.2 I think the reason I got my progress stuck in 2.1 is that my PC have hibernated automatically after idle, maybe code something that detects such things, and take whatever action you want on that.
Beta Was this translation helpful? Give feedback.
All reactions