User-friendly model names? #16116
Describe your questionMy model names are coming from inference profiles, eg.:
Then in Settings → Model definitions, I define this model with a user-friendly name of When listing Observations of type First thing I checked was if the model properly matches the definition and I confirm that it does, because:
What am I missing? Why is the Langfuse Cloud or Self-Hosted?Self-Hosted If Self-Hosted3.224.1 If Langfuse CloudNo response SDK and integration versionsNo response Pre-Submission Checklist
|
Replies: 1 comment 2 replies
|
You're not missing anything — the Bedrock reporting region-prefixed inference profile IDs or full ARNs as the model string is expected behavior, and the fix for pricing is exactly what you did: a custom model definition whose regex Displaying the name of the matched model definition in the UI and charts instead of the raw ingested model ID is an open feature request, along with the related ask to have Langfuse resolve Bedrock inference profile IDs to their base model IDs or alias multiple IDs to one canonical model so usage charts aren't fragmented.(2) You can follow or add your use case there. In the meantime, for cleaner analytics you can group cost by model in a dashboard or sort by the 📚 Sources:
Have another question? Just tag @inkeep. |
You're not missing anything — the
Modelcolumn shows the raw model string ingested from the trace, not the name of the matched model definition. Since your Bedrock calls report the application inference profile ARN as the model string, that ARN is what appears in the column, even though the definition matched correctly (which is why your costs are calculated and the observations show under the definition's model observations).(1)Bedrock reporting region-prefixed inference profile IDs or full ARNs as the model string is expected behavior, and the fix for pricing is exactly what you did: a custom model definition whose regex
match_patternmatches the exact string your traces report. User-d…