Skip to content
This repository has been archived by the owner on Feb 1, 2024. It is now read-only.

Reduce pageSize when downloading to 10 #1763

Merged
merged 1 commit into from Mar 22, 2022

Conversation

jwalgran
Copy link
Contributor

@jwalgran jwalgran commented Mar 22, 2022

Overview

At a pageSize of 50 with detail=true we are seeing response times near 30s, sometimes timing out.

In some brief testing reducing the pageSize to 10 results in requests that take 3 to 6 seconds. Setting a pageSize of 20 doubles the response time but interestingly setting a pageSize of 5 doe not reduce the request time. There appears to be a performance floor.

Demo

The effects of reducing page size in production

Screen Shot 2022-03-22 at 1 33 36 PM

Download testing in development

Screen Shot 2022-03-22 at 1 40 20 PM

Testing Instructions

  • Open the network tab
  • Download a CSV and verify that the data requests have a page size of 10

Checklist

  • fixup! commits have been squashed
  • CI passes after rebase
  • CHANGELOG.md updated with summary of features or fixes, following Keep a Changelog guidelines

At a pageSize of 50 with `detail=true` we are seeing response times near 30s,
sometimes timing out.

In some brief testing reducing the pageSize to 10 results in requests that take
3 to 6 seconds. Setting a pageSize of 20 doubles the response time but
interestingly setting a pageSize of 5 doe _not_ reduce the request time. There
appears to be a performance floor.
@jwalgran jwalgran force-pushed the feature/jcw/download-10-at-a-time branch from 6f637c6 to 35b0a21 Compare March 22, 2022 20:28
@jwalgran jwalgran marked this pull request as ready for review March 22, 2022 20:35
@jwalgran
Copy link
Contributor Author

@TaiWilkin reviewed this with me on a screenshare so I will merge this.

@jwalgran jwalgran merged commit 7b07634 into develop Mar 22, 2022
@jwalgran jwalgran deleted the feature/jcw/download-10-at-a-time branch March 22, 2022 20:42
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant