Supported language codes in `expectedOutputs`

[amio]

Encountered this error The requested language options are not supported.. while calling LanguageModel.create() with expectedOutputs: { type: 'text', languages: ['zh-CN'] }

I did some tests, en|ja is supported, zh|zh-CN|ko is not.

Is there a list for all supported lang codes?

[domenic]

This appears to be a bug report against a specific implementation of this API (probably Chrome's), and not against the specification. As such, it should be reported against that implementation's bug tracker. For Chrome, that's https://crbug.new/.

[amio]

Thanks @domenic !

Is this api LanguageModel.create() expected to support all legal lang codes in https://www.rfc-editor.org/rfc/rfc5646.html ?

Hence the error message "The requested language options are not supported", I guess there's a supported list maintained internally. If so, may we provide a method to detect supported language?

[domenic]

Is this api LanguageModel.create() expected to support all legal lang codes in

No

If so, may we provide a method to detect supported language?

The method is called availability().

[tomayac]

The method is called availability().

// German isn't supported:
await LanguageModel.availability({
  expectedInputs: [{ type: "text", languages: ["de"] }],
  expectedOutputs: [{ type: "text", languages: ["de"] }],
});
// 'unavailable'

// But English is supported:
await LanguageModel.availability({
  expectedInputs: [{ type: "text", languages: ["en"] }],
  expectedOutputs: [{ type: "text", languages: ["en"] }],
});
// 'available' (or 'downloadable' or 'downloading', depending on the model's status)

[amio]

Thanks @tomayac ! With this api we can test if a language supported, but not list all available output languages. Theoretically I can test against all languages to compose the list, but that's not an ideal solution.

Something like LanguageModel.capabilities() => { output: [{ type: string, languages: string[] }] } would be nice in this case. Or maybe other ideas, what do you think?

[domenic]

Can you explain your use case for needing the list of languages? You should know what language your prompt is being written in.

[tomayac]

I think the use case here is to dynamically decide what language to let the model respond in.

const language = languageSelect.value;
const prompt = `Tell me a joke, but in ${language}`;

@amio, note that the availability() function also considers the expectedOutputs:

[amio]

Yes, exactly, I'd like to create an selector for user to customize output language, so I need the available language list. I assume the available language may change over time, so I prefer not to hard code it.

I use to state the output language in system prompt, it works (even with zh, jp, etc.) but not stable. This expectedOutputs seems perfectly fit, just missing an available list.