Add integration with evaluation frameworks #1867
johnnydevriese
started this conversation in
Ideas
Replies: 1 comment
-
We are currently thinking about how to best account for traces run by eval functions, it seems like more native support for this would be interesting. No amazing solution for this yet in Langfuse but you could potentially eval every trace independently and get a single trace for it. Then, you could add the trace url to the comment of the score to easily jump from trace to the eval trace. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Describe the feature or potential improvement
It would be ideal to group both the main question and answer and the evaluation into one thread while still using the decorator style workflow.
For example this works great:
However, I get multiple threads in langfuse so it is difficult to see what the associated scores were from Ragas.
Additional information
No response
Beta Was this translation helpful? Give feedback.
All reactions