granular data retention settings #11225
emieldatalytica
started this conversation in
Ideas
Replies: 2 comments 1 reply
|
Ideally, data retention would have the option to not delete the trace, but instead obfuscate its contents while retaining useful metadata. The motivation is to be able to see latency, usage per user, cost etc despite data retention being in place. Currently, we have accomplished this actioning a cron job every day to replace the input and output of traces and their spans except for if they have a user-volunteered score, in which case we retain the contents of the trace. Thanks, |
1 reply
|
Hi all, thanks a lot for raising this. We have more granular data retention settings on our roadmap. |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
I'd like to have some more granularity on data retention settings.
The problem I'm facing is: I have a high volume of traffic on production, therefore, I implemented a 7-day data retention period (along with a sampling rate). I'm doing offline experiments as well in non-prod environments, but those traces disappear after 7 days, even though I'd like to check experiment runs in depth more when coming back to it later.
Would it be possible to:
Additional information:
I'm running Langfuse on a self-hosted instance.
All reactions