Currently the whole dataset is loaded and then filtered/reduced. Instead the json should be streamed so that very large datasets can be handeled better. Whilst the data is being streamed progress should be shown to the user.
The current requests lib being used (Axios) doesn't support this therefore we will have to adopt the Fetch API. This may come at the cost of browser back-compatability.
Currently the whole dataset is loaded and then filtered/reduced. Instead the json should be streamed so that very large datasets can be handeled better. Whilst the data is being streamed progress should be shown to the user.
The current requests lib being used (Axios) doesn't support this therefore we will have to adopt the Fetch API. This may come at the cost of browser back-compatability.