Skip to content

[server] A few WCAA performance improvements#694

Merged
gaojieliu merged 4 commits intolinkedin:mainfrom
gaojieliu:aa_wc_optimization
Nov 1, 2023
Merged

[server] A few WCAA performance improvements#694
gaojieliu merged 4 commits intolinkedin:mainfrom
gaojieliu:aa_wc_optimization

Conversation

@gaojieliu
Copy link
Copy Markdown
Contributor

@gaojieliu gaojieliu commented Oct 12, 2023

  1. Adopt fast-avro in the AAWC code path.
  2. Use a schema-id based serde cache to avoid expensive schema comparison.
  3. Dynamically choose the right structure for different logics, such as
    LinkedList vs ArrayList.

How was this PR tested?

CI

Does this PR introduce any user-facing changes?

  • No. You can skip the rest of this section.
  • Yes. Make sure to explain your proposed changes and call out the behavior change.

@FelixGV
Copy link
Copy Markdown
Contributor

FelixGV commented Oct 12, 2023

I recall that one of the WC code paths has a comment explaining why LL is used here... can you search for it and make sure there is no unintended effect? If it still looks good, then let's update or delete that comment...

@FelixGV
Copy link
Copy Markdown
Contributor

FelixGV commented Oct 12, 2023

1. Adopt fast-avro in the AAWC code path.
2. Use a schema-id based serde cache to avoid expensive schema comparison.
3. Dynamically choose the right structure for different logics, such as
   LinkedList vs ArrayList.
@gaojieliu gaojieliu changed the title [server] use the default array implementation instead of linkedlist to improve WC perf [server] A few WCAA performance improvements Oct 27, 2023
@gaojieliu gaojieliu requested review from FelixGV and sixpluszero and removed request for sixpluszero October 30, 2023 17:34
Copy link
Copy Markdown
Contributor

@FelixGV FelixGV left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Gaojie. I left a few minor comments. Looking forward to merging this in!

Copy link
Copy Markdown
Contributor

@FelixGV FelixGV left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Thanks!

@gaojieliu gaojieliu merged commit 216c2c5 into linkedin:main Nov 1, 2023
elijahgrimaldi pushed a commit to elijahgrimaldi/venice that referenced this pull request Nov 1, 2023
* [server] A few WCAA performance improvements

1. Adopt fast-avro in the AAWC code path.
2. Use a schema-id based serde cache to avoid expensive schema comparison.
3. Dynamically choose the right structure for different logics, such as
   LinkedList vs ArrayList.

* Fixed spotbug issue

* Fixed test coverage issue

* Addressed comments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants