Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

EdgeHub: Upstream perf improvements #1006

Merged
merged 27 commits into from
Apr 3, 2019
Merged

Conversation

varunpuranik
Copy link
Contributor

This PR includes the following -

  • Prefetching messages from store for processing (should benefit all messaging endpoints)
  • Batching messages while sending upstream
  • Processing upstream messages for each client in parallel
  • Increasing batch size to process based on endpoint fan-out factor

With these changes, a perf gain of 6-8x was observed in testing.

@varunpuranik varunpuranik merged commit 864b33d into Azure:master Apr 3, 2019
myagley added a commit to myagley/iotedge that referenced this pull request Sep 27, 2019
myagley added a commit to myagley/iotedge that referenced this pull request Sep 27, 2019
myagley added a commit to myagley/iotedge that referenced this pull request Sep 27, 2019
myagley added a commit to myagley/iotedge that referenced this pull request Sep 27, 2019
richma-ms added a commit to richma-ms/iotedge that referenced this pull request Sep 30, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants