Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Profile ML-API-Adapter Notification Handler in isolation #3470

Closed
10 of 23 tasks
PaulGregoryBaker opened this issue Aug 11, 2023 · 1 comment
Closed
10 of 23 tasks

Profile ML-API-Adapter Notification Handler in isolation #3470

PaulGregoryBaker opened this issue Aug 11, 2023 · 1 comment

Comments

@PaulGregoryBaker
Copy link

PaulGregoryBaker commented Aug 11, 2023

Goal:

As a team working on optimising the performance
I want to profile the ML API notifications handler
so that identify what performance problems in the code.

Note:
In the transfers performance characterisation work, an issue was identified in the ML-API-Adapter Notification Handler that deserves closer scrutiny. I.e. its one of the components showing the usage of resources (i.e CPU).
Running this in a profiler in an isolated environment will help show up the problem. This story is to do that.

Acceptance Criteria:

  • Verify that the ML-API-Adapter Notification Handler implementation matches the design [@sri-miriyala]
    • Document any gaps or issues, and create follow-up stories as needed
  • Verify that the ML-API-Adapter Notification Handler is tested in isolation
  • Verify that the ML-API-Adapter Notification Handler is profiled
  • Verify that noteworthy findings/observations are documented
  • Verify that the problems identified are either fixed if small, or that stories to perform the fix are created.
    • Verify if http keep alive is configured and tested

Complexity: <High|Medium|Low> > A short comment to remind the reason for the rating

Uncertainty: <High|Medium|Low> > A short comment to remind the reason for the rating


Tasks:

  • Compare ML API Notification Handler design against the code (Sri)
  • Review ML documentation on notification handler
  • kafka cat example notification messages for load
  • Profile notification handler with mock cl admin and dumped kafkacat messages
  • Create stories for identified issues
  • Apply fixes to central-services-shared
  • Run isolated performance tests and capture graphana dashbaords
  • Document findings in performance repo

Done

  • Acceptance Criteria pass
  • Designs are up-to date
  • Unit Tests pass
  • Integration Tests pass
  • Code Style & Coverage meets standards
  • Changes made to config (default.json) are broadcast to team and follow-up tasks added to update helm charts and other deployment config.
  • TBD

Pull Requests:

  • TBD

Follow-up:

  • N/A

Dependencies:

  • N/A

Accountability:

  • Owner: TBC
  • QA/Review: TBC
@PaulGregoryBaker PaulGregoryBaker changed the title Profile ML-API-Adapter Notification Handler Profile ML-API-Adapter Notification Handler in isolation Aug 11, 2023
@JaneS321
Copy link

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants