feat(datasets): ability to delete evaluator from evaluator library

[marliessophie]

Describe the feature or potential improvement

Allow users to delete custom evaluators from the evaluator library. Langfuse and Langfuse partner managed evaluators will remain immutable and cannot be deleted.

Additional information

No response

[jannikmaierhoefer]

+1

[BBYNAI]

Has there been any updates regarding this feature? I feel it is an essential thing to have.

[marliessophie]

Not yet. Will update here when we move on this.

[shakafromanothafaka]

+1

[cijaaimee]

This feels like a massive oversight. Any updates on when this will be added? Are there any workarounds to delete an evaluator template?

[jedmoutahir-ai]

This issue is very important. There is no way to delete, rename or organize in folders / tag evaluators. Why is this still not fixed ? This is the core of langfuse: Evaluators.

[marliessophie]

I appreciate your feedback. This is a committed roadmap item for next quarter. I will ping here once done.

[danielstankw]

@marliessophie whats the logic behind the decision?
I can not find any logical reason why someone would not supported from the start. Its similar to blocking users from deleting datasets ...