Dataset metadata not available during generation in Experiments (Self-Hosted)

[jeet-patel-us]

Describe your question

Hi, I’m using the self-hosted version of Langfuse with experiment-based evaluation. My dataset items contain input, expected_output and metadata.

Issue:
During experiment execution, only input is available to the generation. The dataset item metadata is visible in the UI but not accessible during generation, I’m using a custom OpenAI-compatible endpoint based on OpenAI API.

Need:
I require dataset metadata during generation to:

• Control prompt logic
• Route requests dynamically

Is there any supported way to access it during generation?

Any guidance or recommended workaround would be appreciated. Thanks!

Langfuse Cloud or Self-Hosted?

Self-Hosted

If Self-Hosted

v3.135.1

If Langfuse Cloud

No response

SDK and integration versions

@langfuse/otel: 4.4.2
@langfuse/tracing: 4.4.2
@openrouter/ai-sdk-provider: 1.2.3
@opentelemetry/sdk-node: 0.208.0
ai: 5.0.97

Pre-Submission Checklist

• I have checked for existing issues/discussions and consulted Langfuse AI.

[jannikmaierhoefer]

Thanks @jeet-patel-us, currently, Dataset Experiments in the UI can only access the dataset item input. To also access the dataset item metadata, you can run the Dataset Experient via the SDK: https://langfuse.com/docs/evaluation/experiments/experiments-via-sdk
Hope this helps!