Support parallel access?

[oldpotatooo]

When i to completion code using plugin, blocked if the other one to generate code, need to config that at server side to support parallel processing generate code?

[mitya52]

I suppose that you're using 15b model like starcoder. Requests from multiple users shouldn't block each other. But server process it with batch size 1. So if you change model, for example, to Refact/1.6B, multiple requests will work smooth.

[olegklimov]

It supports queueing for parallel access from several people, the Enterprise version even specifically addresses this.