Support different types of dataset, like agentic dataset

[juliewang-hue]

Describe the feature or potential improvement

Currently only one type includes input, output, metadata.
But we need to prepare dataset for agentic, includes scenario, persona, and expected output.
So that can generate a corresponding dataset

Additional information

No response

[jannikmaierhoefer]

Thanks for sharing this @juliewang-hue! In which tool did you make these screenshots? Curious to check it out.

The current recommended workaround is to use a JSON structure in the dataset input item or use the dataset item metadata.

[juliewang-hue]

The screenshot is from Maxim.
The main thing is that if support types are provided, it can auto-generate the dataset with more accuracy.
Also, can you support auto-generate dataset on the UI?

[jannikmaierhoefer]

Thanks @juliewang-hue. Auto-generation of datasets in UI is also on our roadmap. In the meantime, we published a python notebook for this: https://langfuse.com/guides/cookbook/example_synthetic_datasets