Support to Brazilian Portuguese

[paulovasconcellos-hotmart]

Hi, will Metavoice support languages such as Brazilian Portuguese? I've noticed that the fine-tuning code is not available yet. Is it possible to contribute in some way?

[lucapericlp]

Hey @paulovasconcellos-hotmart , we've just published an initial approach for finetuning the last N transformer blocks of the first stage LLM. Best to play around with the hyperparams in finetune_params.py as we didn't determine the optimal set. Let us know if you have any issues or if you're up for contributing any improvements (via param sweep or otherwise!)

Next step to improve finetuning effectiveness is to have LoRA adapters for the first stage LLM which is being worked on here.

[lucapericlp]

Closing due to inactivity.