Complex/Custom Graphs on Custom Dashboards

[anshmove37]

Hi, I need to plot some custom graphs on a custom dashboard. While I can do basic plots with the current capability, I am interested in being able to do more custom work. For example, plot values of multiple score variables (created through score configs) on the same graph. Right now for one score I have to make one graph. Or even create something like a word cloud. For example, I am creating a score that contains if the trace had an issue or not (True/False) and attach the issue summary as a comment on the score. Since LLMs are a lot about text, it would be helpful if we can do some sort of plots for text. So for example in this case, a word cloud built from all the comments attached to the different True/False scores.

I am looking to use Langfuse not just for LLM observability but also as a dashboard for performance, usage metrics (for which there are some existing features, but there could be a lot more). Right now because of this limitation I have to do these more complex graphs elsewhere which beats the purpose of one single source of truth that contains everything.

Is there any work planned along these lines?

[inkeep-ai-assistant[bot]]

Based on the available documentation, the current custom dashboard functionality in Langfuse does not support plotting multiple score variables on a single graph(1). Each widget is designed to visualize one metric at a time(1)(2).

The custom dashboards feature allows you to create widgets with various chart types (line charts, bar charts, time series) and select from metrics around count, latency, cost, and scores(1)(2). You can filter by metadata, timestamps, and other properties, and arrange multiple widgets on a dashboard using the drag-and-drop interface(1)(2).

However, for combining multiple score types into a single visualization, this capability is not currently available in the widget builder. As noted in community discussions, users have encountered similar limitations when trying to visualize multiple score types together(3)(4).

For more advanced custom analytics beyond what the UI supports, you can use the Metrics API or Query API to programmatically access your data and build custom visualizations externally(1). This would allow you to create the complex, multi-metric graphs you need while still pulling data from Langfuse as your single source of truth.

Check out these potentially useful sources for more context on custom dashboards and their current capabilities:

• Custom Dashboards(1)
• How we Built Scalable & Customizable Dashboards(5)

Would you like me to provide a general answer about potential workarounds using the Metrics API?

**

📚 Sources:

1. Custom Dashboards
2. Custom Dashboards - Langfuse
3. Creating a custom Dashboard by score type
4. Custom Dashboard Widget: Group by custom_score metadata property
5. How we Built Scalable & Customizable Dashboards - Langfuse Blog

---

Have another question? Just tag @inkeep.

[jannikmaierhoefer]

Hi @anshmove37, yes we are tracking improveent ideas for the Langfuse dashboards here: https://langfuse.com/ideas