Slow loading of outgoing messages page and exporting data

[vishnus]

Hi team,

We have processed few million emails so far using Postal. We have a raw message retention for 7 days and meta data for 180 days. The outgoing messages page is extremely slow because of the number of messages. I can see that its loading all messages and then its paginated which is probably why its this slow. Can this be paginated and fetched first and loaded instead of just a UI pagination? The UI takes atleast 3-4 minutes to load (had to increase server timeouts drastically)

Also we'd like to download few reports like suppression email ids, bounce list etc. Is it possible to export them without having to use webhooks? (feature request:) )

[willpower232]

There is a general lack of reports and metrics from Postal at the minute, I'm not sure if that will be picked up. I'd like to see some more stats in the UI and some customisations.

The page loading issue is interesting though, can you send us a screenshot of the pagination to get an idea of the numbers involved?

Something like

I'd like to think that its just the page count that is falling apart but will need to have a look at the code for it first.

[vishnus]

Just the chrome network tab for outgoing:

And the screenshot you requested:

[vishnus]

Another interesting thing is, if we give a search term, say just email, which is not a valid filter it shows this red banner

But again, this shows up after 2-3 minutes of fetching data which shouldnt be the case. Validation of input should be done in front end also i suppose?

[willpower232]

Without reworking the page to include an ajax loaded list (similar to jQuery DataTables) theres not really a lot that can be done in the short term.

[adamcooke]

Postal just stores messages in the MySQL database so making queries for messages depends on the speed of the MySQL server itself. We have added indexes for common searches but there may be some missing and/or simply too much mail to handle quickly. We've seen some speed issues with loading message lists on servers that handle lots of mail so we may be able to investigate this ourselves. I've made a note of this on our internal task tracking and we'll try and take a look soon.

[shopglobal]

Sorry if this is not be the place to ask.. How are you getting the API to work with external applications? So far we got everything working and test emails are ok! But when attempting to use external platform with the API it's not working.. any tips appreciated!

…

On Jan 13, 2018 1:54 PM, "Adam Cooke" ***@***.***> wrote: Closed #429 <#429>. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#429 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AMMA53fewhND6FymDuTgz1JdjIykjaeLks5tKPv2gaJpZM4RAP_h> .

[willpower232]

@shopglobal please open a new issue with the problems you are experiencing

[shopglobal]

#306 #293 please offer any assistance. Thanks On Jan 13, 2018 2:05 PM, "Will Power" <notifications@github.com> wrote: @shopglobal <https://github.com/shopglobal> please open a new issue with the problems you are experiencing — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#429 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AMMA5_6r0GdgcAT_RT7hnl0S2VJa8Zc6ks5tKP57gaJpZM4RAP_h> .