[hub] - hf hub internal api no longer returns an error for invalid access tokens when using listFiles for a gated model

[phudtran]

Issue

Hi, not sure if this is the correct place to post this issue since it seems to be an internal api change.

Previously, listing files in a gated repo using listFiles with an invalid or undefined access token would throw an authentication error. Now the authentication error is not thrown until an attempt is made to download one of the gated files with said invalid token.

Would it be possible/within scope to add some kind of hint to specify whether or not the user provided access token used in listModels/listFiles is able to access the gated model.

Example

For example, when going to https://huggingface.co/google/gemma-2b/tree/main, I am immediately informed whether or not I have access to the gated model.

Use case

Jellybox allows users to input their access token to download gated models after accepting the model conditions.

[coyotte508]

Hi @phudtran

The thing is that it's now possible to list gated files with the API.

If you want to check if a model is gated, I just created a PR adding modelInfo: #946

You can then do:

const info = await modelInfo({name: "some-model"});
console.log(info.gated);

[coyotte508]

Available in @huggingface/hub@0.18.0 :)

[coyotte508]

And await checkRepoAccess({repo: <model name>, accessToken: "..."}) is available in 0.18.1: #947

[phudtran]

And await checkRepoAccess({repo: <model name>, accessToken: "..."}) is available in 0.18.1: #947

Got it! Thank you!