Skip to content

Conversation

@cmanallen
Copy link
Member

Package has no publically disclosed CVEs. Need analysis and implementation plan details: https://www.notion.so/Q4-25-Recording-Consumer-Improvements-28c8b10e4b5d803cb212e19aebefee81

@joshuarli joshuarli merged commit e68b529 into main Oct 14, 2025
15 checks passed
@joshuarli joshuarli deleted the cmanallen/msgspec branch October 14, 2025 21:42
cmanallen added a commit to getsentry/sentry that referenced this pull request Oct 15, 2025
…101195)

`msgspec` allows us to partially deserialize a JSON payload. By removing
the requirement to deserialize full and incremental snapshots, we a
significantly increase the performance of the deserialization and
significantly reduce the memory consumption.

This is particularly important as our consumer suffers from memory usage
issue and our single-threaded processing logic is a bottleneck to
throughput improvements. Experiments demonstrated a 10x performance
uplift and memory usage declined to, essentially, nil.

There is a downside. We can no longer read data from incremental
snapshots or full snapshots. To do so would require allocating memory
and defeat the purpose of this PR. Presently we don't do anything with
those events except log some canvas events which, I think, are
unimportant enough we can remove them.

Full plan:
https://www.notion.so/sentry/Q4-25-Recording-Consumer-Improvements-28c8b10e4b5d803cb212e19aebefee81

Related: getsentry/pypi#1695

---------

Co-authored-by: getsantry[bot] <66042841+getsantry[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants