How I can enable load balancing in local?

[santime27]

Hello everyone, can I enable load balancing in local? and how.

[patryk20120]

What service do you want to load balance? Web is already doing that with pnpm

[santime27]

I wanna enable load balancing with LLM and balancing the model provider API calls between two or more, api credentials. Is this possible?

[zhangever]

I wanna enable load balancing with LLM and balancing the model provider API calls between two or more, api credentials. Is this possible?

This is a paid module. You can find the plan here: https://dify.ai/pricing

[santime27]

Yes, I'm absolutelly clear about this and I know that this feature is a paid feature in Cloud, but I asked about "How I can enable load balancing in local?" this means that in the source code there are some way to do this.

• I expose the db service and join in the Data Base, I can see the model provider tables and I change the bool column "load_balancing_enable".

• This change enable the load balancing feature in Local.

But I ask about if someone did this in the source code.

[yuyongkratos]

@santime27 Which version of dify are you using?

[LockD0wn7]

Yes, I'm absolutelly clear about this and I know that this feature is a paid feature in Cloud, but I asked about "How I can enable load balancing in local?" this means that in the source code there are some way to do this.是的，我对此非常清楚，我知道此功能是 Cloud 中的付费功能，但我问道“我如何在本地启用负载均衡”，这意味着在源代码中有一些方法可以做到这一点。

• I expose the db service and join in the Data Base, I can see the model provider tables and I change the bool column "load_balancing_enable".我公开了数据库服务并联接了数据库，我可以看到模型提供程序表，并更改了布尔列“load_balancing_enable”。

* This change enable the load balancing feature in Local.此更改将启用 Local 中的负载均衡功能。 But I ask about if someone did this in the source code.但我问是否有人在源代码中这样做了。

Can this really enable load balancing?

[crazywoola]

This feature only available in our enterprise version.