Translate to Japanese

[hiromu166]

Hi there 👋

Let's translate the course to YOUR-LANG so that the whole community can benefit from this resource 🌎!

Below are the chapters and files that need translating - let us know here if you'd like to translate any and we'll add your name to the list. Once you're finished, open a pull request and tag this issue by including #issue-number in the description, where issue-number is the number of this issue.

🙋 If you'd like others to help you with the translation, you can also post in our forums or tag @_lewtun on Twitter to gain some visibility.

We've also created a japanese-translations channel on the Hugging Face Discord in case you wish to discuss translation details there. Just follow the instructions here 👉 https://discord.gg/hKnxnxUr

Chapters

0 - Setup

• 1.mdx @hiromu166

1 - Transformer models

• 1.mdx @hiromu166
• 2.mdx @hiromu166
• 3.mdx @hiromu166
• 4.mdx @hiromu166
• 5.mdx @hiromu166
• 6.mdx @hiromu166
• 7.mdx @hiromu166
• 8.mdx @hiromu166
• 9.mdx @hiromu166
• 10.mdx @hiromu166

2 - Using 🤗 Transformers

• 1.mdx @yurikimura
• 2.mdx @yurikimura
• 3.mdx @yurikimura
• 4.mdx @yurikimura
• 5.mdx @yurikimura
• 6.mdx @yurikimura
• 7.mdx @yurikimura
• 8.mdx @yurikimura

3 - Fine-tuning a pretrained model

• 1.mdx @shotaro-funai
• 2.mdx @shotaro-funai
• 3.mdx @shotaro-funai
• 3_tf.mdx @shotaro-funai
• 4.mdx @SodaTetsuhiro
• 5.mdx @SodaTetsuhiro
• 6.mdx @SodaTetsuhiro

4 - Sharing models and tokenizers

• 1.mdx @HiromuHota
• 2.mdx @HiromuHota
• 3.mdx @HiromuHota
• 4.mdx @HiromuHota
• 5.mdx @HiromuHota
• 6.mdx @HiromuHota

5 - The 🤗 Datasets library

• 1.mdx @kojimano
• 2.mdx @kojimano
• 3.mdx @kojimano
• 4.mdx @kojimano
• 5.mdx @kojimano
• 6.mdx @kojimano
• 7.mdx @kojimano
• 8.mdx @kojimano

6 - The 🤗 Tokenizers library

• 1.mdx @kuriyan1204
• 2.mdx @kuriyan1204
• 3.mdx @kuriyan1204
• 3b.mdx @kuriyan1204
• 4.mdx @kuriyan1204
• 5.mdx @kuriyan1204
• 6.mdx @kuriyan1204
• 7.mdx @kuriyan1204
• 8.mdx @kuriyan1204
• 9.mdx @kuriyan1204
• 10.mdx @kuriyan1204

7 - Main NLP tasks

• 1.mdx @webbigdata-jp
• 2.mdx @webbigdata-jp
• 3.mdx @webbigdata-jp
• 4.mdx @webbigdata-jp
• 5.mdx @webbigdata-jp
• 6.mdx @webbigdata-jp
• 7.mdx @webbigdata-jp
• 8.mdx @webbigdata-jp
• 9.mdx @webbigdata-jp

8 - How to ask for help

• 1.mdx @younesbelkada
• 2.mdx @younesbelkada
• 3.mdx @younesbelkada
• 4.mdx @younesbelkada
• 4_tf.mdx @younesbelkada
• 5.mdx @younesbelkada
• 6.mdx @younesbelkada
• 7.mdx @younesbelkada

Events

• 1.mdx @trtd56

[shotaro-funai]

I'd like to translate a part of Chapter 3 - Fine-tuning a pretrained model (3.1, 3.2, and 3.3).
Can I ask you to add my name to the list?

[hiromu166]

Hi @shotaro-funai.
Of course! I added your name to the list.
Thank you for your cooperation.

[yurikimura]

Hello @hiromu166 @shotaro-funai,
I'd like to ask you if I could work on chapter 2.
Also I need to apologize that I did chapter 1/2 by mistake, maybe I should decline and close the PR, but I appreciate if I could have any suggestion about it.
#169

[hiromu166]

Hi @yurikimura.

I'd like to ask you if I could work on chapter 2.

Sure! Thank you for your cooperation.

Also I need to apologize that I did chapter 1/2 by mistake, maybe I should decline and close the PR, but I appreciate if I could have any suggestion about it.

Oh, I see. Unfortunately, I've already translated chapter 1/2 in my local, so could you close #169? I'm sorry to trouble you...

[yurikimura]

Hello @hiromu166 ,
I appreciate letting me do the 2nd part!
I have closed #169 now. Thank you for taking care of it!

[fxmarty]

@younesbelkada

[younesbelkada]

@hiromu166 @yurikimura
Hey there! I am more than interested on your project - since I am familiar with japanese I guess I can help and see if I can validate your translations, I have few questions

• the discord link seems to be expired?
• Where can I find your final PRs? Japanese Translation of Chapter 1/2 #169 seems to be closed
  cc @lewtun

[yurikimura]

Hello @younesbelkada, I am very sorry for late response.
I'm new here and I couldn't sure if I'd give you 100% correct answer, but as far as I know is following;

• The link for discord's expired, maybe we don't have a specific channel but can have a discussion here
• The final PR should be Translate to Japanese Chapter1/1 #144 so far seeing https://huggingface.co/course/ja/chapter1/1
  I hope the answer could be somewhat helpful to you.

[younesbelkada]

Hi @yurikimura
Thank you for your message!
Ok we can continue the discussion on this thread. Is there a plan to continue the translation? Also could you share with me your Twitter account? We want to Tweet this thread to the community to try to bring more contributors
よろしくお願いします！

[kojimano]

Hi @yurikimura, I heard of this project from @younesbelkada, and I'm also more than happy to contribute!
I'm a native Japanese speaker, doing a Ph.D. in the U.S. (also currently interning at HF). Pretty sure I can be useful here :)

[hiromu166]

Sorry, I haven't checked this thread lately.

@younesbelkada
Thank you for your offer of cooperation! That's great for us.
As @yurikimura answered, we can continue the discussion here and our final PR is #144 .

Is there a plan to continue the translation? Also could you share with me your Twitter account? We want to Tweet this thread to the community to try to bring more contributors

Yes. My Twitter account is https://twitter.com/hiromoon166. That's a good idea to share this thread :)

@yurikimura
Thank you for answering the questions!

[hiromu166]

@kojimano
I appreciate your cooperation!

I'm a native Japanese speaker, doing a Ph.D. in the U.S. (also currently interning at HF). Pretty sure I can be useful here :)

Wow! That's awesome! If you would like to translate some parts, please let me know.

[younesbelkada]

Perfect here is the thread!
https://twitter.com/ybelkada/status/1532990394279116800?s=21&t=BpfDGoBzyc6coX7g0j3mFg

[HiromuHota]

Hi all, I'm happy to take "4 - Sharing models and tokenizers"!

[SodaTetsuhiro]

Hi @hiromu166 ,
I found this project on Twitter.
I'd like to translate all the rest of Chapter 3. Can I ask you to add my name to the list?
I'm a native Japanese speaker, majoring in computer science at university in the U.S., so I'm a good fit for this project!

[younesbelkada]

Thank you all for your contributions ! Can't wait to read the Japanese translations 🔥

[kojimano]

Let me do Chapter 5? @hiromu166, do you mind updating the list above? Thanks!
So excited to see this collaborative effort 🤗

[hiromu166]

@HiromuHota @SodaTetsuhiro @kojimano

Thank you all :)
I've updated the list. Please check it.

[kuriyan1204]

Hi @hiromu166 , can I do the chapter6? Appreciate if you could add me on the list🤗

[webbigdata-jp]

Hi. @hiromu166.
I saw this project on Twitter.
Can I do the chapter7 Main NLP tasks?

[younesbelkada]

Hi @hiromu166 !
I am happy to do chapter8! Could you please add me on the list?
Very happy and excited to see all this efforts!

[younesbelkada]

Also feel free to share your PRs once you have created it :) do not hesistate to request for our reviews as well for peer reviewing

[trtd56]

Hi @hiromu166 ! 🤗
I saw this project on Twitter but I guess I'm late...
Can I do the last "Events"?

[hiromu166]

@kuriyan1204 @webbigdata-jp @younesbelkada @trtd56

Thank you all :)
I've updated the list. Please check it.

[HiromuHota]

I'm wondering if anyone wants to discuss things more casually and in real-time.
There is #japanese-translations channel in HF's discord, hope to see you guys there!

We've also created a japanese-translations channel on the Hugging Face Discord in case you wish to discuss translation details there. Just follow the instructions here 👉 https://discord.gg/hKnxnxUr

[younesbelkada]

Would love to join the discord! But it seems that I can't. Probably the link has expired .. could you send another link please?

[HiromuHota]

@younesbelkada Thanks for your interest! I believe you can use this http://hf.co/join/discord (or see https://discuss.huggingface.co/t/join-the-hugging-face-discord/11263).

[HiromuHota]

@younesbelkada and those who are interested, once you've joined HF's discord, react to this message in #course-translations with a :hugging_earth: emoji to show hidden channels like #japanese-translations.

[younesbelkada]

Perfect just managed to join the channel!

[webbigdata-jp]

hi.
I have stamped the discord channel.

By the way, I submitted a pull request and it failed with the following error.
files need to be formatted, run make style
https://github.com/huggingface/course/runs/6847421797?check_suite_focus=true

It seems to be an error that the file name is wrong, however, make style is not a problem in my local environment.
Does anyone know the cause of this?

[HiromuHota]

@webbigdata-jp According to the GitHub Action, what failed was make quality. Do the followings:

1. Run pip install -r requirements.txt
2. Run make style
3. Commit changed files and push

[webbigdata-jp]

(hf_course) dev2@pop-os:~/git/course$ pip install -r requirements.txt Requirement already satisfied: nbformat>=5.1.3 in /home/dev2/anaconda3/envs/hf_course/lib/python3.10/site-packages (from -r requirements.txt (line 1)) (5.4.0) Requirement already satisfied: PyYAML>=5.4.1 in /home/dev2/anaconda3/envs/hf_course/lib/python3.10/site-packages (from -r requirements.txt (line 2)) (6.0) Requirement already satisfied: black in /home/dev2/anaconda3/envs/hf_course/lib/python3.10/site-packages (from -r requirements.txt (line 3)) (19.10b0) Requirement already satisfied: jupyter-core in /home/dev2/anaconda3/envs/hf_course/lib/python3.10/site-packages (from nbformat>=5.1.3->-r requirements.txt (line 1)) (4.10.0) Requirement already satisfied: fastjsonschema in /home/dev2/anaconda3/envs/hf_course/lib/python3.10/site-packages (from nbformat>=5.1.3->-r requirements.txt (line 1)) (2.15.3) Requirement already satisfied: traitlets>=5.1 in /home/dev2/anaconda3/envs/hf_course/lib/python3.10/site-packages (from nbformat>=5.1.3->-r requirements.txt (line 1)) (5.2.2.post1) Requirement already satisfied: jsonschema>=2.6 in /home/dev2/anaconda3/envs/hf_course/lib/python3.10/site-packages (from nbformat>=5.1.3->-r requirements.txt (line 1)) (4.6.0) Requirement already satisfied: toml>=0.9.4 in /home/dev2/anaconda3/envs/hf_course/lib/python3.10/site-packages (from black->-r requirements.txt (line 3)) (0.10.2) Requirement already satisfied: pathspec<1,>=0.6 in /home/dev2/anaconda3/envs/hf_course/lib/python3.10/site-packages (from black->-r requirements.txt (line 3)) (0.7.0) Requirement already satisfied: regex in /home/dev2/anaconda3/envs/hf_course/lib/python3.10/site-packages (from black->-r requirements.txt (line 3)) (2022.3.15) Requirement already satisfied: attrs>=18.1.0 in /home/dev2/anaconda3/envs/hf_course/lib/python3.10/site-packages (from black->-r requirements.txt (line 3)) (21.4.0) Requirement already satisfied: appdirs in /home/dev2/anaconda3/envs/hf_course/lib/python3.10/site-packages (from black->-r requirements.txt (line 3)) (1.4.4) Requirement already satisfied: click>=6.5 in /home/dev2/anaconda3/envs/hf_course/lib/python3.10/site-packages (from black->-r requirements.txt (line 3)) (8.0.4) Requirement already satisfied: typed-ast>=1.4.0 in /home/dev2/anaconda3/envs/hf_course/lib/python3.10/site-packages (from black->-r requirements.txt (line 3)) (1.5.4) Requirement already satisfied: pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0 in /home/dev2/anaconda3/envs/hf_course/lib/python3.10/site-packages (from jsonschema>=2.6->nbformat>=5.1.3->-r requirements.txt (line 1)) (0.18.1) (hf_course) dev2@pop-os:~/git/course$ make style python utils/code_formatter.py (hf_course) dev2@pop-os:~/git/course$
I think it may be because the version of python is different.

[younesbelkada]

Here is my draft PR: #249 in case anyone want already review it!
Please feel free to share your PR even if they are WIP ;)

[HiromuHota]

@webbigdata-jp I believe you resolved the issue already, but black needed to be 22.3.0. This #252 will help prevent an issue like this going forward.

[webbigdata-jp]

@HiromuHota @younesbelkada

Thanks for the advice.
I have re-created the python 3.10 environment in conda with python 3.6.
Now the test passes, but I didn't realize that black was the cause.

I haven't read through the discord yet, but I'll catch up later.

[younesbelkada]

Hi @hiromu166 !
Could you please update the table below to have a broader view of the remaining chapters to translate 🙏 I think we have 3 chapters left if I am not mistaken
Thanks a lot !

[hiromu166]

Could you please update the table below to have a broader view of the remaining chapters to translate 🙏

Sorry, I don't get what should I do... Could you tell me a little more detail?
(Do you mean to put a checkmark in the table above?)

[HiromuHota]

@hiromu166 I believe @younesbelkada is referring to the table in the issue description (the very top of this page). Please check the item that's done.

[younesbelkada]

@hiromu166 sorry I was unclear , yes I meant the table in the issue description since some chapter has been already translated ;)

[webbigdata-jp]

Oh, my bad.
I thought hiromu166 and HiromuHota were the same person.
Sorry if I mentioned something wrong.

[hiromu166]

I've updated the table! (chapter4 & event)
Thank you for letting me know.