-
Notifications
You must be signed in to change notification settings - Fork 51
Conversation
Thanks for your pull request. It looks like this may be your first contribution to a Google open source project (if not, look below for help). Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA). 📝 Please visit https://cla.developers.google.com/ to sign. Once you've signed (or fixed any issues), please reply here with What to do if you already signed the CLAIndividual signers
Corporate signers
ℹ️ Googlers: Go here for more info. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the PR Mehdi! Also please make sure to follow Google Bot's instructions and sign the CLA
Thanks for your pull request. It looks like this may be your first contribution to a Google open source project (if not, look below for help). Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA). 📝 Please visit https://cla.developers.google.com/ to sign. Once you've signed (or fixed any issues), please reply here with What to do if you already signed the CLAIndividual signers
Corporate signers
ℹ️ Googlers: Go here for more info. |
@googlebot I signed it! |
@MorganR , I have done the changes you asked me to, and signed the CLA. |
Hi @CallmeMehdi
The model files are currently containing within an |
|
||
## License | ||
|
||
[SOFTWARE LICENSE AGREEMENT - AraBERT](https://github.com/snakers4/silero-models/blob/master/LICENSE) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Shouldn't this be https://github.com/aub-mind/arabert/blob/master/arabert/LICENSE ?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, absolutely, I think I didn't save when I changed it. Changing it right now.
@MorganR I have added the changes you requested, can you please check them for me. Thank you. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looking much better! Nearly there
@@ -1,6 +1,6 @@ | |||
# Module callmemehdi/arabert/1 | |||
|
|||
AraBERT is an Arabic pretrained lanaguage model based on Google's BERT architechture. | |||
AraBERT is an Arabic pretrained lanaguage model based on Google's BERT base architechture. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nit: architecture
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm sorry Morgan I didn't get this remark.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just a small typo in architecture. You have an extra h part way through the word.
@@ -1,6 +1,6 @@ | |||
# Module callmemehdi/arabert/1 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please update the 'arabert' casing here or in the folder name so that they match
|
||
``` | ||
|
||
We need to take the last hidden state with ``` outputs[0] ``` which has the following shape: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It might be helpful to describe the outputs more. What else does the model output?
@MorganR, I've added the recent modification requests in the last commit, make sure to tell me if there are any notes or questions about it |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just a few more small changes.
@@ -1,6 +1,6 @@ | |||
# Module callmemehdi/arabert/1 | |||
|
|||
AraBERT is an Arabic pretrained lanaguage model based on Google's BERT architechture. | |||
AraBERT is an Arabic pretrained lanaguage model based on Google's BERT base architechture. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just a small typo in architecture. You have an extra h part way through the word.
|
||
3- Hidden states: Tuple of tf.Tensor (one for the output of the embeddings + one for the output of each layer) of shape (batch_size, sequence_length, hidden_size). | ||
|
||
We are interested in the last hidden output which is accessed with ``` outputs[0] ``` and has the following shape: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm not sure this bit is needed. A person using this model may be interested in any of the outputs.
``` | ||
(1, sequence_length, 768) | ||
|
||
With sequence_length the number of words in the input text |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This explanation of sequence length is helpful. It could be included in point 1 above.
@MorganR , I have done these changes you requested, please tell me if there is anything else you want me to change. |
Thank you for your contribution. Your pull request has been accepted according to the TensorFlow Hub Terms of Service at www.tfhub.dev/terms and Google's Privacy Policy at https://www.google.com/policies/privacy. Your model should appear on tfhub.dev within a day. |
Any pull request you open is subject to the TensorFlow Hub Terms of Service at www.tfhub.dev/terms and Google's Privacy Policy at https://www.google.com/policies/privacy.