Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Perf: Client parallelize requests for one file at a time #16

Closed
hopeyen opened this issue Dec 1, 2023 · 1 comment
Closed

Perf: Client parallelize requests for one file at a time #16

hopeyen opened this issue Dec 1, 2023 · 1 comment
Assignees
Labels
p2 Medium priority size:medium Medium type:refactor Changes not visible to users
Milestone

Comments

@hopeyen
Copy link
Collaborator

hopeyen commented Dec 1, 2023

Client already make parallel requests for indexer status, make further obvious client-side improvements

  • Optimize the nested loop on calculating chunk range and making requests
  • Open file once, write multiple times
  • Make a few requests in parallel
@hopeyen hopeyen added type:refactor Changes not visible to users size:medium Medium p2 Medium priority labels Dec 1, 2023
@hopeyen hopeyen self-assigned this Dec 1, 2023
@hopeyen hopeyen mentioned this issue Dec 5, 2023
33 tasks
@hopeyen
Copy link
Collaborator Author

hopeyen commented Dec 6, 2023

Prepare a chunk download e4acdfd
Parallel tasks for each chunk eaa38eb
Request based on leftover chunk indices: be8fee8
Resolved

@hopeyen hopeyen closed this as completed Dec 6, 2023
@hopeyen hopeyen added this to the MVP milestone Dec 15, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
p2 Medium priority size:medium Medium type:refactor Changes not visible to users
Projects
None yet
Development

No branches or pull requests

1 participant