Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Documentation for seq_flow_lite #10773

Open
1 task done
jasonw247 opened this issue Sep 9, 2022 · 0 comments
Open
1 task done

Add Documentation for seq_flow_lite #10773

jasonw247 opened this issue Sep 9, 2022 · 0 comments
Assignees
Labels
models:research models that come under research directory type:feature

Comments

@jasonw247
Copy link

Prerequisites

Please answer the following question for yourself before submitting an issue.

  • I checked to make sure that this feature has not been requested already.

1. The entire URL of the file you are using

https://github.com/tensorflow/models/tree/master/research/seq_flow_lite

2. Describe the feature you request

Would it be possible to document or provide the process for pre-training ByteQRNN on multilingual data? Additionally, are there any plans to release model checkpoints?

I read the blog post here which mentions that pre-trained and finetuned ByteQRNN models were evaluated against BERT on the civil_comments dataset and that the models were pre-trained using multilingual data. I would be interested in trying to reproduce this, as well as using the pre-trained models for transfer learning on my own multilingual data (classification + NER).

3. Additional context

N/A

4. Are you willing to contribute it? (Yes or No)

Yes

@jasonw247 jasonw247 added models:research models that come under research directory type:feature labels Sep 9, 2022
@thunderfyc thunderfyc assigned thunderfyc and unassigned thunderfyc Sep 14, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
models:research models that come under research directory type:feature
Projects
None yet
Development

No branches or pull requests

3 participants