Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Improve][Common] Add UUID in MonitorIndex #7098

Closed
2 tasks done
gosonzhang opened this issue Dec 30, 2022 · 0 comments · Fixed by #7099
Closed
2 tasks done

[Improve][Common] Add UUID in MonitorIndex #7098

gosonzhang opened this issue Dec 30, 2022 · 0 comments · Fixed by #7099
Assignees
Milestone

Comments

@gosonzhang
Copy link
Contributor

Description

We use MonitorIndex to output the minute-level indicator data of production and consumption, and output the records to log files for collection and processing by third-party tools.

In actual use, we found that after the collected indicator data is aggregated, these records do not have a clear distinction, so that when the data is aggregated, multiple fields need to be associated to distinguish whether it is a duplicate record, so we need to add additional A unique UUID field value enables fast deduplication during data processing. We plan to ensure that the data of a specified node is unique by adding a field: log output time + output record sequence ID.

InLong Component

Other for not specified component

Are you willing to submit PR?

  • Yes, I am willing to submit a PR!

Code of Conduct

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants