-
Notifications
You must be signed in to change notification settings - Fork 66
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
docs: document multilingual clip #611
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
make sure in the end all imports are sorted
docs/notebooks/using_mclip.ipynb
Outdated
}, | ||
"nbformat": 4, | ||
"nbformat_minor": 5 | ||
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The method of pulling data and the use of 'cpu' were for testing purposes, updated now
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
left some comments
4612783
to
bb651c9
Compare
82c62d7
to
5677347
Compare
231d5dc
to
5c98a72
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
added two comments
Co-authored-by: George Mastrapas <32414777+gmastrapas@users.noreply.github.com>
docs/notebooks/using_mclip.md
Outdated
<!-- #endregion --> | ||
|
||
## Before and After | ||
We can directly compare the results of our fine-tuned model with an untrained multilingual clip model by displaying the matches each model has for the same query, while the difference between the results of the two models are quite similar for some queries, the examples below clearly show that finetuning increses the quality of the search results: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
"while the difference [...] are quite similar" I think here is something wrong in the sentence?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
differences*
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
yes but also "the difference are similar" makes no sense
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
corrected to differences
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice work!
521547c
to
d61d7f1
Compare
<!-- #endregion --> | ||
|
||
## Before and After | ||
We can directly compare the results of our fine-tuned model with an untrained multilingual clip model by displaying the matches each model has for the same query, while the differences between the results of the two models are quite similar for some queries, the examples below clearly show that finetuning increses the quality of the search results: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We can directly compare the results of our fine-tuned model with an untrained multilingual clip model by displaying the matches each model has for the same query, while the differences between the results of the two models are quite similar for some queries, the examples below clearly show that finetuning increses the quality of the search results: | |
We can directly compare the results of our fine-tuned model with an untrained multilingual clip model by displaying the matches each model has for the same query, while the differences between the results of the two models are quite subtile for some queries, the examples below clearly show that finetuning increses the quality of the search results: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
its subtle
…jina-ai/finetuner into docs-document-multilingual-CLIP
d61d7f1
to
eeacfbf
Compare
"id": "72867ba9-6a8c-4b14-acbf-487ea0a61836", | ||
"metadata": {}, | ||
"source": [ | ||
"# Multilingual Text-To-Image search with MultilingualCLIP\n", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
"# Multilingual Text-To-Image search with MultilingualCLIP\n", | |
"# Multilingual Text-to-Image search with MultilingualCLIP\n", |
72b04f6
to
12459b0
Compare
📝 Docs are deployed on https://ft-docs-document-multilingual-CLIP--jina-docs.netlify.app 🎉 |
This pr adds a notebook showing how to use the soon to be added multilingual clip model