distilkobert-tfhub-examples

Example codes for DistilKoBERT in tfhub.dev

DistilKoBERT in tfhub.dev

• encoder: https://tfhub.dev/jeongukjae/distilkobert_cased_L-3_H-768_A-12/1
• preprocessor: https://tfhub.dev/jeongukjae/distilkobert_cased_preprocess/1

Example training code

• nsmc
  • training code: distilkobert_nsmc_tpu.ipynb
  • dataset: https://jeongukjae.github.io/tfds-korean/datasets/nsmc.html
• kornli
  • training code: distilkobert_kornli_tpu.ipynb
  • dataset: https://jeongukjae.github.io/tfds-korean/datasets/kornli.html