Custom model Pricing configuration JSON

[winningcode]

Can we disable the deafult model prices config and load the custom pricing model configuration ? Currently langfuse is loading default-model-prices.json by default, How do we override this with custom JSON ?

[dosubot[bot]]

Hey there, @winningcode! I'm here to help you with any bugs, questions, or contributions you have. Let's tackle this issue together while we wait for a human maintainer.

Currently, Langfuse loads the default-model-prices.json file by default for model pricing configurations. However, there is no documented method or configuration setting available to specify a custom JSON file for model pricing instead of using the default one. The upsertDefaultModelPrices function directly imports the default-model-prices.json file from the ../constants/ directory, and there are no command-line arguments, flags, or environment variables mentioned in the documentation that allow you to override this behavior with a custom JSON file ^[1].

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other}

[marcklingen]

This is currently not possible through JSON; however, you can change the prices programmatically using the models API.

[winningcode]

okay. Thanks for responding .
Do we have support for multimodal LLMs and also for image models to compute the tokens and cost. ?

[marcklingen]

Yes

• https://langfuse.com/docs/tracing-features/multi-modality
• https://langfuse.com/docs/model-usage-and-cost