feat: Write received_p99 to commit log #4872
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
evanh
approved these changes
Oct 18, 2023
nikhars
approved these changes
Oct 18, 2023
|
PR reverted: 2d3fc18 |
getsentry-bot
added a commit
that referenced
this pull request
Oct 19, 2023
This reverts commit c7db591. Co-authored-by: lynnagara <1779792+lynnagara@users.noreply.github.com>
lynnagara
added a commit
that referenced
this pull request
Oct 19, 2023
This reverts commit 2d3fc18.
ayirr7
pushed a commit
that referenced
this pull request
Oct 19, 2023
This supports the subscriptions to opt into using received_p99 for scheduling instead of the current orig_message_ts Needs getsentry/arroyo#295
ayirr7
pushed a commit
that referenced
this pull request
Oct 19, 2023
This reverts commit c7db591. Co-authored-by: lynnagara <1779792+lynnagara@users.noreply.github.com>
lynnagara
added a commit
that referenced
this pull request
Oct 19, 2023
ayirr7
pushed a commit
that referenced
this pull request
Oct 24, 2023
This reverts commit c7db591. Co-authored-by: lynnagara <1779792+lynnagara@users.noreply.github.com>
ayirr7
added a commit
that referenced
this pull request
Nov 1, 2023
…rs (#4912) * add migrations for tables * update to use anyLast (this doesn't work) * try with argMax aggregate function * rename migrations * renumber migrations * renumber migrations again * add raw_timestamp column * fix test distributed storage set key * add granularity-specific retention day columns to raw table * Sum aggregate function instead of count. * remove storage set key creations * remove extra column and add max timestamp aggregation * add gauges storage set key to migration group * feat(rust): Update all dependencies in lockfile (#4892) * feat: Write received_p99 to commit log (#4872) This supports the subscriptions to opt into using received_p99 for scheduling instead of the current orig_message_ts Needs getsentry/arroyo#295 * Revert "feat: Write received_p99 to commit log (#4872)" This reverts commit c7db591. Co-authored-by: lynnagara <1779792+lynnagara@users.noreply.github.com> * initial pass, writable storage * fix output type for gauges messages * note on dlq * write path working * add entity, readable storage for querying * switch to mat view version2 * add tests for gauges processor * add gauges entity key * fix readable gauge storage schema * remove avg from gauges migration * Revert "feat: Write received_p99 to commit log (#4872)" This reverts commit c7db591. Co-authored-by: lynnagara <1779792+lynnagara@users.noreply.github.com> * ref(subscriptions): Move --delay-seconds from CLI arg to yaml definition (#4915) The main motivations for this are: 1. The amount of delay depends on the synchronization timestamp used, and this is defined at the storage level in code. For example if "orig_message_ts" is used, a longer delay will be applied than if "received_p99" is used, since received will be set earlier in the pipeline. 2. The same CLI args get applied in all Sentry deployments, and this makes it easier to keep them in sync 3. Rolling out different values per storage via CLI will probably break some of our templates and require too much rework. There are no functional changes here since we have 60 configured everywhere right now. * feat(rust): Add strategy that does json schema validation (#4901) * spans: add profile_id to tests (#4827) * add test for spans profile_id and fix bug where test was dependent on local timezone * test: Refactor API tests to not reference sessions so it can be removed (#4920) * fix merge conflict * remove avgs support in dataset (storage, entity) and processor * fix aggregate function in entity * add some comments --------- Co-authored-by: Lyn Nagara <lyn.nagara@gmail.com> Co-authored-by: getsentry-bot <bot@sentry.io> Co-authored-by: lynnagara <1779792+lynnagara@users.noreply.github.com> Co-authored-by: Dalitso Banda <dalitso.banda@sentry.io>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This supports the subscriptions to opt into using received_p99 for scheduling instead of the current orig_message_ts
Needs getsentry/arroyo#295