Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make collections retrieval parallel #210

Merged
merged 2 commits into from
Feb 26, 2023
Merged

Make collections retrieval parallel #210

merged 2 commits into from
Feb 26, 2023

Conversation

stmcginnis
Copy link
Owner

@stmcginnis stmcginnis commented Oct 24, 2022

This makes calls to get the objects from a collection link parallel.

Some collections can contain a large number of items to retrieve. Doing this serially can have a noticable performance impact. This change allows three fetches in parallel so we don't overwhelm the Redfish service and cause a denial of service. With three concurrent operations we can be processing some responses while queuing up the more, making it a lot faster to process.

stmcginnis and others added 2 commits November 26, 2022 10:53
This makes calls to get the objects from a collection link parallel.
Some collections can contain a large number of items to retrieve. Doing
this serially can have a noticable performance impact. This change
allows three fetches in parallel so we don't overwhelm the Redfish
service and cause a denial of service. With three concurrent operations
we can be processing some responses while queuing up the more, making it
a lot faster to process.

Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
Co-Authored-by: Lorenzo Bolognesi <lorenzo.bolognesi@dxc.com>
This hasn't been very useful, so just disable it.

Signed-off-by: Sean McGinnis <stmcg@amazon.com>
@stmcginnis stmcginnis changed the title Make PCIeDevice collection parallel Make collections retrieval parallel Nov 26, 2022
@stmcginnis
Copy link
Owner Author

Been out here long enough. Was hoping for external validation that things are working well, but I'm sure I'll find out soon enough if there are issues. ;)

@stmcginnis stmcginnis merged commit 0c59dde into main Feb 26, 2023
@stmcginnis stmcginnis deleted the pci-async branch February 26, 2023 15:47
feuerrot pushed a commit to babiel/gofish that referenced this pull request May 24, 2023
* Make collection retrievals parallel

This makes calls to get the objects from a collection link parallel.
Some collections can contain a large number of items to retrieve. Doing
this serially can have a noticable performance impact. This change
allows three fetches in parallel so we don't overwhelm the Redfish
service and cause a denial of service. With three concurrent operations
we can be processing some responses while queuing up the more, making it
a lot faster to process.

Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
Co-Authored-by: Lorenzo Bolognesi <lorenzo.bolognesi@dxc.com>

* Disable gomnd linter

This hasn't been very useful, so just disable it.

Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
Co-authored-by: Lorenzo Bolognesi <lorenzo.bolognesi@dxc.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant