Skip to content

Clean scroll context#8967

Merged
kezhenxu94 merged 2 commits intomasterfrom
clean-scroll-context
May 6, 2022
Merged

Clean scroll context#8967
kezhenxu94 merged 2 commits intomasterfrom
clean-scroll-context

Conversation

@kezhenxu94
Copy link
Copy Markdown
Member

  • If this pull request closes/resolves/fixes an existing issue, replace the issue number. Closes #.
  • Update the CHANGES log.

* Add data-generator module to run OAP in testing mode, generating mock data for testing.
* Support receive Kubernetes processes from gRPC protocol.
* Fix the problem that es index(TimeSeriesTable, eg. endpoint_traffic, alarm_record) didn't create even after rerun with init-mode. This problem caused the OAP server to fail to start when the OAP server was down for more than a day.
* Clean up scroll contexts after used.
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would this cause OOM or something?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Usually this is not a critical problem as the context has an expiration time (30s), but in high volume of clusters (millions of service /network aliases that the all results cannot be retrieved within the expiration time) this would cause

Trying to create too many scroll contexts. Must be less than or equal to: [500]. This limit can be set by changing the [search.max_open_scroll_context] setting

@kezhenxu94
Copy link
Copy Markdown
Member Author

After I verified I'll mark it "Ready for review", before that let's hold this

@kezhenxu94 kezhenxu94 force-pushed the clean-scroll-context branch 6 times, most recently from 4729f28 to 98e5cd4 Compare May 4, 2022 12:22
@kezhenxu94 kezhenxu94 force-pushed the clean-scroll-context branch from 98e5cd4 to d71c076 Compare May 4, 2022 12:22
@kezhenxu94 kezhenxu94 requested a review from wu-sheng May 6, 2022 00:45
@kezhenxu94 kezhenxu94 added backend OAP backend related. enhancement Enhancement on performance or codes labels May 6, 2022
@kezhenxu94 kezhenxu94 added this to the 9.1.0 milestone May 6, 2022
@kezhenxu94 kezhenxu94 marked this pull request as ready for review May 6, 2022 00:46
@kezhenxu94 kezhenxu94 merged commit 369949b into master May 6, 2022
@kezhenxu94 kezhenxu94 deleted the clean-scroll-context branch May 6, 2022 01:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backend OAP backend related. enhancement Enhancement on performance or codes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants