Add Sessions to Datasets

[rileymiller]

Describe the feature or potential improvement

I've been looking around and haven't been able to find this functionality. I'd like to be able to add sessions (multi-turn conversations) to a dataset so I can run automated evaluators over the entire conversation instead of just a single trace.

It looks like there is support for adding sessions to annotation queues but I'd also like to be able to add them to datasets so I can evaluate the entirety of the conversation rather than only a single turn.

Additional information

Looks like https://github.com/orgs/langfuse/discussions/4208 is similar but is over a year old.

[jannikmaierhoefer]

Hi @rileymiller, thanks for adding this here!

[xstraven]

Same for us, we deal with many sessions where although the mistake is ultimately made in e.g. turn 3, there has been a misunderstanding in turn 1/2 that is the ultimate root cause of the wrong info being given out in turn 3.

[jannikmaierhoefer]

@xstraven @rileymiller, we have a guide on adding conversation turns to a dataset using the SDK for conversational-level evals: https://langfuse.com/blog/2025-10-09-evaluating-multi-turn-conversations
Hope this helps in the meantime.

[xstraven]

thanks!