Increase Recordings retention

[benjackwhite]

Currently for PostHog Cloud we have a 3 week TTL on Recordings. The reason for this is that recordings contain huge amounts of data that over time .
As Recordings are (in most cases) less insightful the older they get, it doesn't make sense to keep all recordings in perpetuity but the current TTL of 3 weeks is not always enough and for many people they would happily pay for the ability to increase the longevity to, for example, 6 months for a variety of reasons.

Describe the solution you'd like

We have internally had many discussions and proposals about this but essentially the core concept for the purpose of this Roadmap issue is:

• Extend the default retention period to 1 month (this is pretty standard across the board)
• Extend the retention period for paying customers to something longer e.g. 3 months - to be decided
• Add an option for individual Teams to extend this storage period with some cost at least to cover our overheads.

Technical notes

• Move the "blob" like data out of Clickhouse and into a two-tiered storage solution - Tier 1 being expensive storage but cheap to write to (we have a few options here) and Tier 2 being cheap storage but expensive (relatively) to write to.
• Change the Clickhouse schema we use to an Aggregating system so that the 1000s of events making up a recording can be neatly compressed into a single representation

Related issues:

• Save old session recordings to S3 #2142
• Session recordings ingester #10799

[pauldambra]

We haven't added "Add an option for individual Teams to extend this storage period with some cost at least to cover our overheads." but other than that we have now completed this.

Everyone gets 30 days retention and paying customers get 90 days