auth-free and non api-key providers

[steamboatid]

Hi all,

is there any simple way to use only auth-free and non api-key providers?

for example,
i want to use gpt-4o-mini model, but only from auth-free and non api-key providers, without selecting provider one by one.

many thanks in advance,
regards

[hlohaus]

Hey @steamboatid,

You can just pick auth-free providers like PollinationsAI or DeepInfra. If you don't pick one, it'll go through all the providers in the model list. If there's no free provider and no provider with an API key that works for the model, you'll get a MissingAuthError first. But it'll still try the free ones anyway.

[steamboatid]

hello @hlohaus,

yes I did that.
but it's not practical when I need to change the model. I will need to pick suitable provider, for the new model.

if the base class of Provider has property of need_api and need_auth,
then when client calling, it just need pass false to need_api and need_auth along with model name.
for example:

response = client.chat.completions.create( model=MODEL, messages=[{"role": "user", "content": [ {"type": "text", "text": prompt_gabung}, {"bucket_id": bucket_id} ]}], stream=False, ignore_stream=True, web_search=False, need_auth=False, need_api=False )

[hlohaus]

Hey, in the Web UI, you can turn off the providers you're not using. Models that don't have any providers will disappear. If you turn on debug logging, you can see how the provider rotation works in AnyProvider Mode.

Models with authfication have already a needs_auth flag:

from g4f.Provider import __providers__

ignored = []
for provider in __providers__:
    if provider.needs_auth or provider.use_nodriver:
        ignored.append(provider.__name__)

@steamboatid

[steamboatid]

if provider.needs_auth or provider.use_nodriver:

GREAT. i will try that.